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(1)  There  are  statistically  significant  performance  differences  for 
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and  thermal  sensors. 

(2)  No  statistically  significant  trend  is  evident  associating  better  or 
worse  performance  as  aperture  size  increases  that  is  independent 
of  the  imagery  type. 
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(5)  ^  No  single  sensor  performs  best  for  all  classes.  The  results  of  ' 
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Preface 

This  study  was  performed  by  Recognition  Systems  for  the  Geographic 
Sciences  .Laboi atory  of  the  U.  S.  Army  Engineer  Topographic  Laboratories 
to  investigate  the  feasibility  of  vising  optical  power  spectrum  analysis 
techniques  for  automatic  topographic  feature  classification  under  Contract 
No.  DAAK70-78-C-0019.  The  contract  duration  was  31  January  1978  to 
1  June  1979.  D.  Craig  Baker  was  the  USAETL  Contracting  Officer's 
Technical  Representative. 


SUMMARY 


1. 0 

I .  I _ Study  Objective 

The  objective  of  this  study  was  to  determine  experimentally 
the  feasibility  of  using  optical  power  spectrum  analysis  techniques  for 
automatic  topographic  feature  classification  from  high  resolution  radar, 
panchromatic  and  thermal  imagery. 

1 .  .1 _ Work  1’erformed 

In  conjunction  with  ET.L  personnel,  a  data  base  of  radar, 
panchromatic  and  thermal  imagery  was  assembled.  Radar  and  panchromatic 
imagery  were  available  over  the  same  geographical  area  with  the  same  scale 
and  perspective.  An  optical  power  spectrum  data  base  of  h,2]t>  individual 
aperture  samples  Crum  the  three  types  of  imagery  was  collected.  Included 
in  this  data  base  were  samples  over  the  same  area  with  different  aperture 
si/.es. 

Feature  analysis  and  decision  software  required  in  addition  to 
standard  FACET  routines  was  developed.  Using  this  software,  features 
and  a  decision  rule  were  developed  for  radar  imagery  that  achieved  90'!'*' 
correct  classification  of  four  classes  of  terrain. 


A  quantitative  statistical  analysis  was  performed  to  determine 
the  effects  of  aperture  and  sensor  type  on  the  performance  of  the  optical 
power  spectrum  based  features.  In  addition,  a  qualitative  analysis  was 
performed  in  order  to  present  example s  that  illustrate  signature  differences 


--Continued. 
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between  radar  .uni  punch  rom.it  ic  imagery. 

1_.  < C o n  c  1  u  s  i< mis 

Tlio  to]  low  ini;  general  conclvisions  were  drawn  from  this  study: 

1)  There  are  statistically  significant  pe  r  lo  rmancr 

differences  for  optical  power  spectrum  based 
algorithms  for  radar,  panchromatic  and  thermal 
sensors, 

•1)  There  is  no  universal  statistically  significant 

aperture  si  e  effect.  In  other  words,  no  trend 
is  evident  associating,  better  or  worse  performance 
as  aperture  si  c  increases  that  is  independent  of 
the  imagery  type. 

3)  For  a  given  type  of  imagery,  there  is  a  statistically 
significant  variation  in  decision  performance  that 
depends  on  aperture  size. 

•1)  For  the  samples  used  in  this  study,  the  single  best 

sensor  is  radar.  It  is  presumed  that  this  is  because 
of  the  greater  texture  variations  present  in  radar 
imagery  compared  to  panchromatic  or  thermal. 

f’)  No  single  sensor  performs  best  for  all  classes.  The 

results  of  this  study  would  lead  to  the  following  choices 
for  the  detection  of  particular  terrain  typos: 

a.  urban  -  panchromatic 

b.  water  -  radar  or  panchromatic 
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c.  agriculture  -  radar 

d.  forest  -  thermal  or  radar 

1  •  4 _ Additional  Studies  Recommended 

The  following  arc  recommended  areas  where  additional  effort 
would  extend  or  improve  the  results  obtained  in  this  study: 

1)  Utilize  similar  features  and  decision  rules  on  a  larger 

data  set  representing  more  geographical  areas  to 
extend  the  statistical  validity  of  these  results. 

Z)  Improve  the  decision  algorithm  and  study  the 

relationship  of  the  present  algorithm  to  the  previously 
developed  FACEL  MISTIC  algorithm. 

3)  Obtain  a  data  base  containing  thermal,  radar  and 
panchromatic  imagery  of  identical  scale  and  perspective 
over  a  single  geographical  area  to  obtain  a  more  precise 
performance  comparison  for  the  three  sensors. 

4)  Formalize  the  approaches  to  boundary  definition  that 
appear  promising  as  a  result  of  this  study. 

5)  Use  boundary  definition  or  other  appropriate  techniques 
to  implement  contextual  processing  in  order  to  improve 
decision  making  in  areas  where  local  texture  is 
insufficient  to  differentiate  between  terrain  types. 
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1.5 


Or;1, a li i /.a lion  of  tin-  Report 


It  is  intended  that  tliis  report  be  self  contained  to  the  extent 
reasonable.  Therefore,  the  report  begins  witli  a  discussion  of  optical 
power  spectrum  sampling  history,  techniques  and  equipment  in  Section  2. 
This  is  followed  by  a  discussion  of  the  experiment  design,  equipment  and 
software  in  Section  3.  A  description  of  the  features  and  decision  rule 
is  found  in  Section  4,  A  detailed  discussion  of  the  statistical  procedures 
used  to  analyze  the  effects  of  aperture  and  imagery  typo  is  presented  in 
Section  5  along  with  the  quantitative  results  that  were  obtained.  Section  6 
contains  a  qualitative  discussion  of  specific  sample  Ol'S  signatures  that 
illustrate  differences  due  to  sensor  type.  Conclusions  and  areas  for 
further  study  are  discussed  in  Section  7, 
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OPTICAL  POWER  SPECTRUM  ANALYSIS  - 
TECI I  NIC  A  L  LAC  KG  ROUN  U 


2.  1 _ Historical  Development 

Diffraction  phenomena  have  been  observed  since  the  early  days 
of  the  development  of  optical  science.  Iluygcns  observed^  ^  that  if  a  screen 
was  placed  to  intercept  a  portion  of  a  light  beam,  then  at  some  distance 
beyond  the  screen,  light  was  visible  as  expected  on  the  side  of  the  beam  not 
obscured  by  the  screen.  But,  in  addition,  light  was  also  visible  on  the  side 
of  the  beam  blocked  by  the  screen.  This  observation  by  Huygens  and  his 
use  of  the  secondary  wavefront  construction  to  predict  the  wavefront  at  an 
arbitrary  distance  beyond  the  screen  arc  early  formulations  of  the  theory 
of  diffraction.  As  the  theory  of  electromagnetic  wave  propagation,  in 
particular,  the  propagation  of  optical  disturbances  was  developed.  The 
superposition  principle  embodied  in  Huygens'  principle  was  developed 
more  formally  as  the  Fresnel-Kii'chhoff  integral  as  a  result  of  the  suitable 
application  of  Green's  theorem.  ^ 

Regardless  of  the  historical  and  matheinatical  development 
leading  to  the  result,  it  became  apparent  that  the  relationship  between  a 
diffraction  pattern  and  the  object  causing  the  diffraction  pattern  was 
a  two-dimensional  Fourier  transform  relationship.  Until  low  power 
helium  neon  lasers  became  available  toward  the  end  of  the  1960's, 
forming  diffraction  patterns  that  could  be  easily  photographed  or  measured 
was  difficult  because  non-laser  monochromatic  sources  could  not  easily 
supply  the  requisite  power.  Once  the  capability  to  generate  the  diffraction 
patterns  associated  with  scenes  imaged  on  transparencies  became  readily 
available,  many  workers  began  to  experiment  with  diffraction  pattern  or 
optical  power  spectrum  analysis  systems. 
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2.  1 


-  -Coni  inuod. 


In  tlu'  remainder  of  this  section,  we  shall  briefly  review  the 
general  optical  configuration  used  to  develop  a  diffraction  pattern,  the 
type  of  equipment  that  is  available  to  sample  diffraction  pattern  data  at 
high  speed,  some  references  to  general  applications  of  the  technique  and 
a  summary  of  the  important  work  that  is  applicable  to  the  study. 

2.  .1 _ tiono  ric  Conti;' i :  rations  for  Optic al  1  'owe  r  Sped  rum _An alv s  i s 

(3) 

.1.  .1.  1  _ Optic .i  1  Ponfisu  r.  i  ion 

The  Abbe  Theory  of  Image  Formation^  ^  implies  that  whenever 
a  point  source  is  imaged  to  a  point  source  the  image  plane  will  contain 
the  diffraction  patti  rn  of  a  transmission  object  placed  anywhere  in  the 
patli  between  the  object  and  image  point  sources.  Specifically,  three 
situations  are  possible  as  shown  in  Figure  .1-1.  The  transmission  object 
may  be  placed  after  the  lens  or  before  the  lens  in  a  diverging  beam  or,  if 
the  point  source  is  at  infinity,  in  a  collimated  beam.  In  general,  it  is 
better  to  have  the  transmission  object  in  the  converging  beam  for  several 
reasons: 

1)  The  lens  pupil  does  not  limit  the  rays  diffracted 
toward  the  detector. 

2)  The  aberration  requirements  on  the  lens  are  much 
less  severe  since  the  incident  illumination  will  be 
either  a  collimated  beam  or  a  diverging  beam  with 
a  known  spherical  wavefront. 

3)  The  possibility  of  ghost  images  at  the  detector  is 
minimised  because  there  is  not  a  direct  path  from 
the  lens  surface  to  the  detector. 
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*  =  spatial  frequencies  coordinates 
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Figure  2-1  A.  Object  before  lens  in  collimated  beam. 
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Figure  2- IB.  Object  after  lens  in  converging  beam. 


2.  2.  1 


-  -Coni  ’inu-vl, 


Tiie  only  situation  in  which  it  may  he  desirable  to  have  the 
transmission  object  before  the  lens  is  when  the  incident  illumination  is 
collimated.  In  this  case,  with  the  transmission  object  in  the  collimated 
beam,  the  position  of  the  object  relative  to  the  lens  or  the  detector  does 
not  affect  the  magnification  of  the  diffraction  pattern,  furthermore,  if 
the  object  is  placed  in  the  hack  focal  plane  of  the  lens  the  quadratic 
phase  factor  i"  the  expression  for  the  diffraction  pattern  disappears. 

Thus,  an  exact  Fourier  transform  relationship  holds  between  the 
transmission  object  and  the  amplitude  pattern  in  the  difiraction  plane. 

Of  course,  in  general,  it  is  the  intensity  pattern  that  is  sampled  so  that 
the  phase  factor  is  of  no  practical  importance. 

Finally,  we  make  one  additional  observation  concerning  the 
general  diffraction  pattern  optical  configuration.  Note  that  although  the 
development  has  been  for  transmissive  and  refractive  optical  elements, 
the  analysis  holds  for  reflective  elements  as  well,  flius,  in  gene i  al, 
any  optical  element  in  the  path  between  the  point  source  object  and  its 
imago  will  contribute  to  the  disturbance  in  the  diffraction  plane.  Therefore 
all  elements  in  the  optical  path  of  a  diffraction  pattern  analysis  system  are 
critical.  Limiting  pupils  within  the  system  may  minimise  high  spatial 
frequency  scatter  from  surfaces  far  from  the  detector  but  each  situation 
must  be  carefully  analyzed. 

2.  2.  2  Fewer  Spectrum  Sampling.  Techniques 

To  this  point  we  have  not  addressed  the  problem  of  how  one 
is  to  measure  the  diffraction  plane  intensity  pattern.  Farly  workers 
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photographed  the  intensity  pat  torn  in  tin-  diffraction  piano  and  attomptod 
to  analy.ro  the  so  photographs.  In  many  cases  this  approach  is  not  viable 
because  of  the  vide  dynamic  rau;.;e  of  the  intonsjtv  pattern  as  a  function 
of  position  in  the  diuraet  .si  plane.  The  limited  dynamic  ran-'e  of  film 
doe.-;  not  allow  a  shade  exposure  to  o.dvqualels  represent  the  entire  r..n >  o 
of  intons  it  y  in  the  diffraction  plane.  Thus  one  is  confronted  v.ith  a 
situation  in  which  an  exposure  designed  to  allow  low  intensity  values  to 
bo  visible  cause  •  high  intensity  regions  to  se.tur.  to  the  film.  If  the 
exposure  is  set  so  11  ..t  lush  intensity  regions  do  not  saturate  the  film, 
low  intensity  rep.  ions  do  not  oxposo  the  film.  Clearly,  some  v  ide 
dynamic  range  readout  mechanism  is  required. 


One  o  the  earliest  systems  developed  specifically  to  sample 
and  recon.  eiifrnetion  patter:  :■  as  Veil  as  perform  pattorn  recognition 
studio.-  on  sampled  diffraction  patterns  was  developed  by  l.ondaris  and 
Stanley.^  I  be  optical  portion  c>f  their  system  is  pictured  in  Figure 
by  utilizing  a  vh  e  select  io  of  nieci:.  :  seed  apertures  and  pb.y;  ically 
moviis  the  injmt  transparency,  they  were  able  to  realise  the  wide  variety 
of  diffraction  pattern  sampling  geometries  and  configurations.  Although 
extremely  general,  anil  suited:  tor  laboratory  experimentation.,  this  system 
was  limited  by  its  inherent  mechanical  nature  insofar  as  diffraction  pattern 
acquisition  speed  was  concerned. 


io  overcome  the  limitations  of  this  type  of  mechanical  approach, 
the  solid  state  photodetector  pictured  in  Figure  .1-3  was  developed  by 
Recognition  Systems  speciiically  to  allow  high  speed  acquisition  of 
diffraction  pattern  data.  This  doteeior  has  subsequently  been  interfaced 
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to  a  wide  variety  of  1 1 j i •, 1 1  speed  analop  sipnal  condit  ioninp  and  ana lop  to 
dipital  conversion  circuitry.  This  lias  enabled  the  development  of  a 
number  of  optical  power  sped  rum  analvsis  systems  for  automatic 
inspection  of  indu:  trial  production  and  automatic  imapery  analysis.  The 
earliest  i>f  these  systvimy  ROSA  (Record in;:  Optical  Spectrum  Analyser), 
has  been  in  use  at  KTT.  since  197.1.  A  system  simila  r  to  the  lit'  1  -  ROS  A 
was  used  to  acquire  the  data  for  this  :  tedv. 


2,  3  \pplicat? (in.s  of  (  plica!  l  ower  Spectrum  \ nalysis 


.  ■ .  I  Goner  1  \pplicntii  is 


(  0  . 


Since  (lie  work  of  I  endaris  •  ■  nd  Stanle  \  jn  the  .tali'  60's, 
optical  ]'o\  er  spectrum  analysis  and  related  se.itti  'in;',  analvsi  '  ’rave  been 
applied  to  a  wide  \ariel\  of  pattern  reei  y,  nit  ion,  automatic  inspection  ami 
imapery  analysis  problems.  Applicatii  as  to  transqia  rency  .uialy;  is  have 


included  pneumoconiosis  (black  .lunj'  disease)  detection  from  x-ray 


(:’) 


rail jop. ra pits  ,  determination  of  the  type  of  dystrophy  disease  from 


muscle  biopsy  photnmicropraphs  ,  analysis  of  pap  smear  material  from 


photomicrographs  of  . ■■•lidos  and  real  time  spatial  lipht  modulator  images 

(7) 


of  smear  material.  Direct  analysis  of  the  scattered  illumination  from 
biolop.ic.il  cells  has  been  used  to  determine  cell  type  distributions  and 

(i>\ 

cell  characteristics.  Scatter  from  laiy.o  numbers  of  particles  lias 
been  used  to  determine  cell  sire  distribution!'-  both  in  terms  of  dimension 


(9)  .  .  . 

and  woipht.  Reflected  scatter  from  paper  and  machine  surfaces  has 


(10) 


been  used  to  determine  paper  quality  and  machine  surface  finish.  Aside 
from  these  lum-imape  ry  based  application:;,  substantial  number  of  imapo 
analysis  applications  (both  classified  and  unclassified)  have  been  developed 
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I'S'IIO  r.l  1  ,  ilu-  WO  rk  o  I  I  i '  'ad  .1  i*  l  :  •  .lid  -  lev  .lin!  1  like:  SUi’.yest:  1  i  10  folh'V  jin’, 
p.onoral  .i tt  rihu  ties  : ah  ',  tri!  with  t.  r ra i n  di f :  :  .  ct ' on  jv. (to  rn  sh'n.'lu  res: 

1)  Man-made  objects  t vpi  oil  1\  Iwvc  ni.inv  of  t'.i  i :  1 1 1  live 

:: t ruelurcs  tvsullinr.  in  diffr.  olion  pattern  eiiers.x 
th.it  is  c !  i :  - 1  rilnit  oil  in  prel'errid  ro't.iioii!.'  r  orients t  ions 
within  (ho  diffr. u-tion  piano. 

■’)  Often  man-made  objects  such  as  city  streets  or  plowed 

fields  appear  as  r,  r.itinr.s  (hat  cause  the  di  K'ra  cl  oil 


enerpy  al  a  pa  r(  icula  r  annular  oriontation  to  break  u]i 
into  a  ilot  ]'.ittorn  similar  to  that  caused  by  a  diffract  ion 
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3)  Natural  object:  tend  to  have  a  uniform  anpular 

dint  ribvili on  of  enerpy.  (One  exception  to  (Ids  jenoral 
perception  cited  by  Lukes^  ^  is  the  case  of  ocean 
waves.  ) 

■1)  The  spatial  frequency  content  of  nahwal  objects  tends 

to  be  concentrated  at  I  ov.  e  r  frequencies  than  the 
sjiatial  frequency  conie  t  a  ssociated  with  man-  made 
objects , 


5)  Generally  .lines  and  edpes  associated  with  buildinps , 

roads  and  other  man-made  structures  tend  to  hi-  shar]’ 

I 

relative  to  (he  tr.'u.snii;  sum  chances  nonii.ill'  found  I 

in  nature  so  flial.  as  a  result  higher  spatial  frequencies 

are  more  prevalent  in  man-made  objects  comjia  red  to  | 

natural  objects.  There  are  of  course  some  exceptions. 

For  example,  mountain  regions  with  an  illumin.dion 
ancle  such  that  craps  and  crevices  are  in  sharp  relief 
compared  to  the  other  mountain  areas  will  typically 
have  hiph  spatial  frequency  content  associated  with  them. 

However  there  is  pene  rally  no  preferred  orientation  so 
that  the  anpular  distribution  of  enerj.’.y  even  in  (his  case 
is  quite  uniform. 


To  summarise,  various  terrain  types  are  characterized  both 
by  the  sjiatial  frequency  distribution  of  enerpy  and  the  sjiatial  orientation 
of  diffracted  enerpy.  Prefer  real  orientation  distributions  and  distributions 
with  relatively  high  sjiatial  frequency  content:  are  characteristic  of  man¬ 
made  objects.  More  pone  rally,  hiphly  textured  scenes  will  have  hiph  spatial 
frequency  content  compared  to  scenes  that  one  would  identify  as  havinp  very 
little  texture. 


Optical  Power  Spectrum  Properties  Imp  >rtan1  for  this  Study 

Tlio  major  properties  of  optical  power  spectrum  arc  essentially 
of  two-dimens  ional  l'ourier  transform::  (lose  ribed  by  banians  ami 
^  and  Kasdan. ^ Specifically  Ibo  proportios  arc: 

])  Sp.di.l  Tn\  •jri._"n'o  -  1ft  y)  ropix  sonts  tbo  spatial 

transmission  at  tbo  object  piano  and  lb{t  (  ,  y)| 

T  (f  ,  C  )  tbo  I'oe.rior  Iron-  form  of  this  function,  then 

Fit  (x-x  ,  y-y  ){ 

'  O  u 

11"  It  (x,y)l  oxp  1  (f  x  I  f  v  )).  (I) 

'  xu  y  o 

who  re  f  ,  f  are  tbo  >atial  freipn  nev  coordinate:  . 
x  y 

From  Kip  (1)  we  sro  tb.  1  the  mapniludo  of  (be 
trans.  form  ;;ivon  by 

1 11"  |  l  (x-x^,  y-y  J  }  f"  |  l  (x,  y)  | 

•  I  exp  ( — Z n  i  (f  x  H  f  v  ))  I  (•’■) 

I  x  o  y  o  I 

is:  unchanged  regardless  of  (lie  posit  ion  of  tbo  object 
determined  by  x  ,  v  .  (This  of  course  assumes  that 

O  '  () 

that  as  a  result  of  tin1  translation  all  of  t  (x,y)  is 
still  within  the  entrance  pupil  of  the  transform  lens.) 
Thus  we  have  the  very  important  result  that  regardless 
of  the  position  of  the  object  in  the  entrance  pupil, 
the  diffraction  pattern  remains  constant. 
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Con  jur.il>’  Svinnu'l  rv  -  Assuming  th.it.  t i i o  spatial 
transmission  at  the  object  I'l.uit’,  t  (x,y)  is  a  real 
function  of  x,  y  (which  will  be  true  if  l(x,y)  represents 
a  transparency  for  example)  then 

T  (fx,  fy)  T*  (-fx,  -fy)  (3) 

wlie  re 

T*  is  the  complex  conjugate  of  T. 

From  Fq.  (3)  we  have 

T  (  x’  fy)  T  (“£x»  -y  I  (1) 

In  otlu  i-  word:  ,  the  lip. I -t  intensity  at  a  point  F  is 
the  same  as  the  intenslh  at  the  conjugate  l'V  found 
at  the  same  radius  as  F  but  ISO  degrees  aw.  y  in 
the  Fourier  plane  as  illustrated  in  Figure 

Frese  rv.it  imi  of  Rot. Aon  -  We  have  seen  that  translation 
of  the  object  affects  only  the  phase  of  the  Fourier  tram  - 
formation.  Rotation  of  the  object  about  the  optical  axis, 
the  center  of  spatial  coordinates,  causes  the  transform 
or  diffraction  pattern  to  be  rotated  about  its  center  of 
spatial  frequency  coordinates  (also  the  optical  axis  in 
this  case)  by  the  same  angular  displacement  as  the 
object.  Thus  rotation  of  the  object  is  preserved  in  the 
transformation  by  an  equal  rotation  of  the  diffraction 


l.incarity  or  Aihiitiyily  -  Thy  woll  known  lino  a rity 
property  of  tho  Fourier  transformation  j;ivyn  by 

IF  {  >‘j  tj  (x,y)  i  a  ,  t  ,  (x,y)  } 
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2.4  —  continued. 
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.1  rbit  iv.  rily  sm..!l  n-i'.ii'M  in  the  input  \  'i .  ;  w  .uul  mo.'.sv.iv  the  d.ifOrael  ior. 
pattern  due  to  this  input  with  .is  po  rfeet  fidelity  .is  we  wit  h.  This  is  due 
t o  Hu-  .Fourier  t  r.. nsJL'orm  rt  lationship  Ci.it  exists  between  the  input  plane 
and  the  diflrnction  plane.  1  Tvciscly  the  same  relationship  exists  between 
a  particle's  position  and  momentum  if  the  particle  satisfies  the  Sell  rood  irr.or 
Wave  liquation. 


Within  an  aperture,  however,  the  linearity  and  conjugate 
symmetry  properties  are  still  valid.  Thus,  an  aperture  that  includes 
multiple  terrain  types  will  have  a  diffraction  pattern  signature  that  in  mam 
cases  closely  app'  'invites  a  linear  combination  of  the  intensity  patterns 
of  the  individual  a  types.  Since  the  result inr,  diffraction  pattern  is 

.11 
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2.  -1 _ —  —  c out  inuc <  1 . 

a  lino,  r  combination,  it  i:'.  not  possible  to  determine  where  within  tlie 
aperture  hound.:  ries  exist  nor  in  fact  the  constituent.',  ot  the  linear 
combin  ation.  The  eonjuy.  to  symmetry  property  implies  that  v.edy.e  riny. 
detector  y.eomet  r\  is  sufficient  to  anal\  e  both  the  radial  dint  rihution  of 
oneri.y  and  any.ul.tr  distribution  of  eneryv. 

One  final  comment  concern  hiy  t’e  po:  it  ‘on  of  objects  wit .  i  u 
the.  aperture,  l  or  objects  t  hat  .  re  small  com)'.,  red  to  the  ape  rturc  si  e, 
property  1  is  a  pood  approximation  to  tin  actual  ilu.  lir:i.  Tina  ,  the 
position  of  the  object  v.itbin  the  ape  rture  does  net  :  :  ii  e  ul\  .  .Meet  t  . 
dil'f re etion  pattern.  On  the  oilier*  hand  for  objects  i  .  .  re  1  rye  compa  red 
to  the  aperture,  the  position  of  the  object  within  1  •  aperture  >  le.  rlv  will 

affect  diffraction  pattern.  \s  an  example  const. \  r  an  opaque  line  with. a 
an  aperture  of  approximately  the  same  d  linens' h  '.  Pepere.  •  upon  t1  e 
location  of  the  litie  v.  itliin  !  ■  aperture  \\  e  have  the  diffraction-  p.  Mem  o l 

eitJier  a  sinyle  slit  or  a  double  slit.  These  diffraction  patterns  are  quite 
different. 

To  sumnuri:  e  the  discussion  in  this  section,  consider  the 
spatial  objects  and  correspondin'',  dit  tract  ion  patterns  pictured  in 
Fipure  2-5.  These  patte  rns  illustrate  the  follow  inp  principles: 

1)  The  diffraction  pattern  corresponding  to  a  line  is 

o 

also  a  line  oriented  at  90  w  ith  respect  to  the  line 
in  the  input  plane. 


>  > 


i)  Handwritten  Numeral  and  Corresponding  Diffraction  l'atte 


h)  "Random"  Scene  and  Corresponding  Diffraction  Pattern 


uure  2-5.  Objects  and  their  diffraction  patterns  illustrating  th 
relationship  between  lines,  circles,  gratings  and 
corresponding  diffraction  patterns. 


COI  t  ilU’.ed. 


The  diffraction  pattern  of  a  circular  p  rutin;',  is  a 
circular  grating,  rati:  ;',  spacing  inversely  proportional 
to  the  j  ratinr.  spacinr  in  tlu-  input  plane.  More  peiierallv 
circularly  symmetric  input  patterns  transform  inti' 
circularly  symmetric  tlifiraction  patterns. 

The  diffraction  pattern  of  a  linear  p  ratine.  is  a 
sequence  of  "ilif ,'r.. ction  spots”  arrayed  aloni,  the  line 
orlhopou.  1  to  tlie  direction  of  the  liner-  in  the  prati:  .  . 
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1  he  objective  of  the  expo  rim,  1  ,!e:  i.  :i  is  to  allow  a  compari;  < 
of  the  <  :ects  of  imagery  ty]  and  apertur  size  on  ability  to  determine 
topo  ■  ■  o  tures .  In  particular,  vxsu  1  represent  tions  of  synthetic 

aperture  radar  reconstructioi  ,  p  e;..  •  tic  imagery  and  pass iv< 
tbe  2  ■  imaj  wer<  tv  npared.  E*opog  rap]  r  cl  ss  es  rep  ■  >  ented 

in  the  ai  ilable  imagery  were  urban,  watei*,  griculture  and  ft  est. 
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of  otl.e 


ri  vit 


geog  rap  <  rc;  .  !  tical  pi  ^er  sj  ctrum  equi  ent  vs  riati 

Huntsville,  ■ :  •  - :  t  area  iitiaj  •  .  was  avails  le  from  both  radar  and 


panchrota;’ :  :c.  seniors 
Unfortu  i.  i-‘l)  ,  amo 


>  ••  :  virtual! ;  id,  tic  1  .-.c  alt  .  nd  pe rsp<  ctive. 
t  ie  sources  invest  ated,  th<  n  ..  1  and  p;  c!  i  oi  •  itic 


iivut g, e r v  .  i t lx  t.  ■  same  good  m.  ter.  of  seal,:  end  pc.rspective  was  not 
available  . 


3.  1,  2 _ P  Tree 

Based  on  the  considerations  above,  the  experiment  design 
desciibed  in  l-igure  3-1  war  selected.  Imagery  for  the  experiment  came 
from  two  major  geographical  areas.  Area  1  is  the  Huntsville,  Alabama 
area.  Area  2  is  a  region  in  Europe.  Synti  otic  aperture  radar  and 
panel’.  ?e.  c..ic  imagery  over  the  same  1  lunt  sville  area  with  virtually  the 
same  scale  was  available.  Thus,  a  direct  comparison  of  the  ability  to 
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3.  1.  3 


—  Cojiti  mud. 


QjJy  apertures  containing  a  single  terrain  type  were  used  in 
the  training  set.  In  general,  several  classes  were  sampled  on  each 
scan  line,  thereby  minimizing  the  effect4  of  equipment  drill  and  variation. 
Addition  11  since  e;  ch  class  was  represented  on  one  or  more  fra .  ics. 
the  effc  ct  of  time  variation  was  minimised.  The  san >ples  not  used  fo r 
training  i  -  cl  scai  li  j  were  available  to  be  part  of  the  validatioi  set. 
Table  3-1  .  nn  ri/.es  the  number  of  tr  ininj  set  and  validation  set 
samples  as  well  .  s  the  uml  er  of  t  rainii  g  set  samples  avail,  ble  for  each 
class. 


Thermal  imagery  was  awiilublc  over  a  region  in  I-mro,  ■ 

The  perspi  dive  and  scale  of  the  corresponding  panchromatic  invy.or; 
was  sij  iificantly  different  than  the  perspective  and  scale  of  the  thermal 
scan  imagery.  In  addition,  the  flight  paths  used  to  record  tne  l>  o 
different  types  of  imagery  had  very  little  overlap  so  that  comparisons 
of  large  numbers  of  apertures  over  identical  areas  would  be  difficult. 

Thus  it  was  decided  that  n  detailed  comparison  of  thermal  imagery  to 
panchromatic  imagery  would  not  he  attempted.  Rather  a  gross  comparison 
of  tiie  results  for  thermal  would  he  compared  to  the  gross  results  for  radar 
and  panel; romatic. 

Due  to  limitation  in  the  optical  configuration,  it  was  impossible 
to  project  on  the  imagery  a  good  quality  aperture  larger  than  about  15  mm. 
For  the  thermal  imagery,  ;  pprovimatcly  n  I  Omm  sample  aperture 
corresponds  to  the  same  ground  area  as  a  2  mm  aperture  for  either  <ho 
radar  or  panchromatic  imagery.  Therefore,  a  10  mm  aperture  vus 
selected.  Results  for  this  aperture  were  compared  to  the  2mm  results 
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1 


Onlic-’I  C<~" -r*  •: 

Tills  system  contains  optic  1  components;  i  1  ciierate  the 
O]  tie;  1  Ft  trie  r  transfi  r  n  -  £  in  cry  placed  in  the  fi]  plane  (Figure  3-4). 

A,  He-Ne  laser  in  e<  j  iction  with  the  Aj  r hire  Project!  Optics  package 
provides  coherent,  circularly  apertured  or  Gaussi;  ill  tion  of  the 

film.  T1  Fourier  Tr:  sform  Optic  collects  i .  i s  1 '  t  as  it  is  diffracted 
from  the  filn  awl  rt  olve:  it  i  t  Optical  Power  Spectrum.  The 
patented  .  edj  Ring  Pliol  de  cl  r  p]  t  1  spoct  ru m  ii  a  polar 
coordinate  ;  e  otr\  .1  produce.-  .  nuhy  i\  .  'cal  :  :  1:;  proportional 

to  the  lip'  '  i -.so  i .  t  esi  1 ;  detector  chu  sent'  .  \11  of  the  tipiic.'.l 

c<  ponent  c  securely  mounl  l  to  a  rij  id  optic;  platform. 

S;  spling  erturcs  of  1  t(  15  mm  are  rea<  y  accomi  i  ted. 

Tin  1  m  Optit  can  h;  dl  "or  : .  ses  fro  >  inch  to 

i .  1  inc  .  .  ■  *  ■  .  :  t  piv  idt  or  sa  ljjli  of  the  aim  with  c  :  1 

frequt  ci  "  frt  cycles  to  8  cycles  ira  respectively.  , 

!  is  combi natioj  and  optical  par  icters  us  !  are  su  iari  d  j  Table  3-2. 

A  closed  cl  TV  is-  incorpore  led  into  th.e  vVwing  system. 

Tlii  provides  a  simultaneo  lagnificd  view  of  the  apertured  laser 
i 1 1  ui  ti  -  031  the  film  and  whit<  Li  ht  illumination  of  tl  s  s  rrou  ling 
film  are  ■  kVith  tliii  clw  ne  the  e  pc  rime  ter  c  obt  in  absolute  verifi¬ 
cation  of  T  e  sample  p>  bit  on  th.e  film. 

3n  2h? _ Film  Tr.-  . mo r_t_ 

The  Film  Transport  provides--  p incision  incremental  translation 
of  the  film  so  •(>.  :■■  the  stationary  laser  illumination.  It  can  accommodate 
roll  film  up  to  «>  1/2  inches  wide.  Motion  resolution  along  the  film  is 


■I  1 


_ -  -Continue  ;_d . 

0.  1mm;  across  the  film  it  is  0.  01  mm.  The  Film  Transport  is  controlled 
by  the  system  computer. 

3.  1,  3 _ F I iv tron IT ;; 

The  sixty  - four  (64)  (3.’.  ring,  3.!  v.  edge)  analog  electrical 
signals  from  the  Ring /V»  edge  I  ’holodolect or  are  individually  amplified, 
multiplexed,  and  A/D  converted  b\  the  RSI  l  IS  DPS  Se  mpling  Unit.  Auto- 
ranging  is  pro\  ided  to  preserve  precision  in  tin  widely  varying  dyi  imic 
range  data.  Tlie  digital  output  U  the  compute  v  for  each  channel  com. .lets 
of  an  eight  bit  mantissa  and  a  three  bit  exponent.  The  1 ISD1  S  j.;  equipped 
witli  sample  aid  hold  circuitry  for  each  ch.  nual.  SamHDg  can  re.  mly 
be  accompli sliod  at  30/is.  per  channel. 


3.  •! 


Controller  a.  :  Cont  rol  S  vftw;  re 


The  Computer  Automation  minicomputer  is  the  system 
controller.  It  contains  a  Floppy  Disc  drive  to  hud  the  system  software 
as  well  we  record  data  acquired  during,  sampling,,  A  TTY  terminal 
provides  the  experimenter  with  an  interactive  interface  to  tin-  system, 
lhe  line  printer  allows  on-line  printout  and  plots  of  the  ring  /wedge  data. 


The  operational  system  software  provides  the  user  with  a 
powerful,  easy-to-use  language  to  control  tin  sampling,  experiment. 

Die  commands  are  int  roduced  by  keywords  and  are  followed  by  optional 
pa  lame  tors.  the  following,  list  outlines  the  major  comm. '.ml  capabilities 

1)  Redefine  default  sampling,  parameters 

•’.)  Frovide  prompts  for  all  optional  input 


Continued 


Define  a  file  name  and  comment 
Define  present  film  coordinates  to  system 
Move  film  to  a  specified  film  location 
High  speed  wind /rewind  of  film 
Sample  film  at  present  coordinates 
Take  samples  in  a  loop 

Sample  over  a  grid.  Terminal  coordinates  and  step 
size  table  defined.  Raster  scan  with /without  retrace 
is  provided. 

Place  end  of  file  on  output  Floppy  Disc 
List  contents  of  a  Floppy  Disc 
Terminate. 


Many  sampling  parameters  are  default  initialized  in  a  table; 
they  may  be  changed  at  any  time.  Some  of  the  more  important  perimeters 
allow  definition  of  the  sampling  grid  and  stopsize,  whether  the  data  is  to 
be  saved  on  a  Floppy  Disc  or  plotted,  the  sample  index,  etc. 


A  unique  feature  of  the  operational  software  is  that  it  is 
written  in  the  BASIC  language  and  executes  in  an  interpretive  mode  under 
control  of  the  BASIC  compiler.  Thus,  new  commands  and  capabilities 
may  be  added  to  the  system  by  the  experimenter  on-line  and  used 
immediately. 


The  system  can  readily  perform  automatic  grid  sampling  and 
recording  at  about  five  (5)  samples  per  minute,  exclusive  of  initial 
manual  film  positioning.  This  rate  includes  automatic  averaging  of  up 
to  1?- 1  consecutive  samples  to  reduce  the  effect  of  random  system  noise. 


3.  2.  -1 


-- Continued. 


Considering  the  above-listed  capabilities,  tbc  111  IDAS  does 
indeed  supply  the  OPS  experimenter  with  a  unique,  efficient  mechanism 
for  acquiring  data.  This  implementation  is  the  product  of  several  man- 
years  of  research  effort  at  Recognition  Systems,  Inc.  and  represents  the 
current  st. . le-of- the -art  in  OPS  sampling  techniques. 

3.  3 _ Ana. lysis  Software 

The  software  described  here  was  designed  to  support  the 
analysis  tasks  in  this  study.  These  routines  were  designed  to  augment 
the  existing.  RSI  developed  1‘ACKD  modules.  The  prime  design  motivation 
of  this  new  software  was  to  aid  the  experimenter  in  feature  sell  ction. 

The  d  ta  consisted  of  ring  /wedge  values.  The.  classes  to  be  separ.-’ed 
were  charade  r.i  red  by  various  topological  fc.  tores. 

In  contra:  L  to  the  controller  software  written  in  JV\SIC,  all  of 
this  .  naly  si  5  softvva re  was  written  in  FORTR  AN  A  .  It  runs  on  a  Computer 
Automation  1  SI- 2  computer.  Many  of  the  lower  level  library  routines  are 
drawn  from  RSI  library  ‘TJMI.IIV.  AH  user  supplied  parameter  inputs  ere 
free  formal  (except  in  routine  ’SORT O’). 

The  software  described  herein  performs  the  following  tasks: 

])  acquire  data  in  the  RSI  RilPA.s  i.icilil} 

2)  plot  the  data  or  clue  files 

3)  list:  the  ds.ta  or  clue  files 

4)  edit  and  classify  the  data 

5)  partition  the  data  into  training  and  recognition  files 

6)  clue  processing  (normal!,  e  the  d  ta,  generate  clue 
files,  generate  threshold  test  limits.,  and  classify 
vectors  based  on  a  threshold  test) 

7)  generate  overlay  grid  for  classification 


3.  3,  1 


Data  Acquisition  Soft  v.'.i  n •  (111'  J l.1.?,  1'APICT) 

'IIDAS291  is  a  BASIC  language  source  file  used  for  controlling 
tlie  data  acquisition  process  in  the  IUIDAS  facility  at  RSI.  It  runs  under 
control  of  the  BASIC  Executive  *  BASIC  T'  which  has  several  machine 
language  routines  to  access  the  ESDI’S,  Motor  Controller  interface-,  and 
the  computer  front  panel. 


3.  3,  2 _ PlotE"-.  Software  f  l  REPOT) 

'PUPPET1  was  developed  to  produce  three  dinien- ne  i  contour 
perspective  data  plots  on  the  Versatec  plotter.  The  perspective  display 
did  not  provide  the  de  ired  vis ibilifcy.  However,  this  routine  is,  an 
excellent  mechanism  for  ove-.'uy  plotting  and  this  lias  been  the  chief 
fea.tur  ■  a. ad  data  display  vehicle  in  the  study. 


'PRI  1  OT*  is;  controlled  by  four  types  of  control  cans'.;: 


1)  title  card  (  1) 


2)  title  card  (.72) 


3)  axis  card 


4)  graph  card 


Places  selected  symbolic 
text  on  the  plot. 

Places  Pac file  header  and 
name  on  the  plot. 

Selects,  graph  type,  scale 
parameters,  labeling.,  etc., 
and  draws  axes. 

Selects  files,  vectors,  labeling, 
and  line  patterns  to  be  drawn. 
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3.  3.  _ --Continued. 

AH  data  plotting  is  done  using  the  C.alcomp  comp  atible  calm 
to  standard  Ycrsatec  software.  A  new  graph  is  started  for  each 
appearance  of  the  'TITLE'  (optional),  and  'AXIS'  parameter  set.  Each 
subsequent  'G RAVI  1'  card  directs  the  plotting  of  its  vector:  on  axes 
specified  by  the  immediately  proceeding  '  \XIS'  card. 

Data  to  he  plotted  can  be  in  either  the  111  IDAS  (source)  or 
FAC  FILE  format. 

3.  3.  3 _ List's;'  Softy,.’  •  •  ( 1 .1ST) 

Program  'LIST'  lists  out  a  selected  range  of  contiguous 
VvCtois  them  a  tile.  1  he  vector's  may  he  specified  bv  pliysica.l  ie.de>:, 
designator,  and  class  label.  The  rang,.'  of  compel  cuts  to  hist  is  also 
Selectable.  The  format  of  the  lino  (narrow  Cor  terminal,  with  for  line 
pi  ..cl)  is  selected  autom.  tically  depending  on  the  output  dev  is e  type. 

All  parameters  are  specified  on  the  /11\  Command  which 
involves  LIST.  The  first  null  option  terminates  the  parameter  scan. 
Delimits  are  assumed  for  null  options. 

Input  files  may  he  either  UP  DAS  or  FACF1PE,  the  proper 
read  mode  being,  automatically  determined  by  M  1ST’. 

3.  _ Fib'  Edit lag  .  a u  Classification 


Program  ’CL.Mli'  provides  the  capability  to  generate  an  output 
file  composed  of  selected  vectors  from  selected  files.  It  is  a  merging 
program  where  the  vectors  to  be  merged  can  be  individually  selected  from 
the  input  files  in  my  order.  Not  all  input  vectors  need  be  copied  to  the 
output  file.  Thus  it  'edits’  the  file. 


•  in 


3.  3.  •! 


--Continued, 


'CL'vlG1  can  generate  a  descriptor  in  the  out] >ut  file  even  if 
tiic  input  had  no  descriptor;  in  general,  it  can  chans, c  (he  output  descriptor 
to  any  arbitrary  length,  including,  aero. 

Input  vectors  maj  be  selected  by  physical  I  idex,  designator, 
or  input  cla.  s.  label. 

Output  class,  label  (if  ..ny)  can  be  set  to  a  specified  value  or 
remain  I1  a  same  as  input.  Thus  vector  class  ification  ca  1  be  performed 
on  designators,  will;  a  possible-  prerequisite  class  label. 

Input  files  maybe  cithe  r  RHDAS  or  FACFII  ES,  the  pr<  per 
i*e ad  mode  boinj  automatically  determined  by  'Cl. MG', 

3,  3.  a _  Vile  I  'a  v!  itioni  eg 

Prop, ram  •SORTD*  selects  groups  of  vectors  from  an  Input 
file  by  class  and  creates  n  new  ovipx'l  file.  A  typical  use  is  to  si  elect 
every  n*  vect  or  for  a  training  d.-ta  set  and  every  k*  "  vector  for  .. 
recognition  data  set. 

The  input:  file  may  be  RHDAS  or  a  FACFII  1 the  proper  read 
mode  be  in.  automatically  determined  by  •SOUTH*. 

3.  3.  0  _ Clue  l’nicr •  Sr 

Gene viitiaii  of  now  features  and  training  and  roeopnit ion  is 
accomplished  with  a  sat  of  rou tines  analogoi  s  to  the  cla.ssic  Cl.V  VlT/'Gl  l1 1 
software  of  l-’ACi-ll  .  The  executive  routine  in  this  package,  'Kl.l'l',1, 


3.  3.  ( 


--  Continued. 


provides.  I/O  services  similar  to  'C.T.Ul  11 T'  with  several  enhancements. 
The  a  dual  clue  jiroccssor  routines  are  named  'I\l . 1'  E  l't:l ,  where 
**  (01,03,  etc.  ). 

Vi  here,  s  the  classic  'CLllElT1 * 3 * 5 6 7  executive  could  access  at 
most  one  clue  sa  E  sou  tine,  one  input  file,  and  only  call  the  chu.  routine 
when  each  vector  was  read,  lire  new  improved  *K1  3  can  access 

multi]  V  clue  routines  and  files,  and  can  also  call  f.  e  clue  rouiie.e  upon 
completion  of  pr  <  e  sing  a  particular  vector  data  set.  The  'KLUE*** 
subroutines  can  ra.iEo  a  vector  by  voder  da eisio.,  ce  .ce  sins,  ''deration 
of  an  output  dat.  vector  and  male  the  d.  ejsion  .  hoot  wlu-n  to  ,  !  ce  .  n 
EOF  on  the  output  file. 

This  facility  hue  been  used  to  impious. —  rormalisatiou, 
auto'n.  lie  thres.liohi  select'd,  recognition,  and  acci  r.v.lal ior  .  f 
performance  si.  '  tics. 

3.  3,  6. 1 . Clue  : '  yo  tivo  (K1  UE) 

The  clue  executive  reads  free  formal  parameter  cards  to 
determine  the  mode  of  operation.  Each  card  can  specify: 

1)  input  file  name  and  device 

3)  input  start  and  end  vector  (designator  or  physical 

index  specification 

3)  input  class  label 

■1)  output  file  name 

5)  output  file  comment 

6)  index  to  clue  routine 

7)  parameters  for  clue  routine. 


I 

I 

|  3.  3.  6.  1 _ --Continued. 

All  parameters  are  optional,  with  a  default  assumption  for 
{  null.  For  example,  if  no  input  file  name  is  specified,  'KLUE1  assumes 

there  is  no  input  file;  similarly  for  the  output  file.  Tin;  comments  of  the 
(  listing  provide  complete  details. 

j  In  order  to  be  legally  specific  d  as  a  clue  index  par.  meter, 

the  corn  spending  'KJ-UE**1  subroutine  mu;  t  exist  in  the  load  module, 
i  If  it  doesn't,  an  error  message  is  reported. 

'KLUFd  can  read  cither  RI3DAS  files  or  FACFILES,  the 
proper  read  mode  beinj  auto  i<  tic;  lly  determined  by  'KLUE1.  Output 
files  are  FAC  FILE  format. 

.  Each  parameter  card  r  ad  by  'KLUE'  is  listed  on  tlic  printer 

for  sul  sequent  ref  rc  -  cc  as  .  re  the  nam  ;s  and  locations  of  the  effective 

files , 


Prior  to  each  call  to  a  'KLUE***  subroutine,  the  input  vector 
designator,  descriptor,  and  data  components  are  copied  to  the  correspond!  g. 
output  vector  arrays.  This  feature  obviates  the  clue  subroutine  from 
having  to  copy  unchanging  vector  data  to  the  output  i  rray. 


I  3.  3.  6.  ?.  Normalisation  (K1  .UE01) 

Clue  subroutine  *ivl  UE011  performs  various  user  selected 
norma li/.riions  on  vector  input  d.it  i.  It  is  called  by  'KLUE'  and  specified 
by  the  clue  index  parameter  -  1. 

I 

l 

52 
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*KI  '  •  *01  1  allows  sjveuiiMtion  t. 


inueponuent  scat.  \  aluc  .or  re  ■ .  we  c  nornvli  ation 
indepond,  nt  startinj  and  e  "■  g  cotnp.  nent  for  rin 
w  od;  '  no  vr' .  . ! :  .  i  ion 
various  now  t  •  ■  ii.  n  r  it'  od:  ouch 


b.  simple  r.  n>  e  of  elem*  (  with  ossibl 
rank  orJi'riii!' 

C.  r.  hod  d;f'.V ro’-A  •  ,  c i . ' . 


3.  3.  (  Clone  '  •  ;_V  -  «  ic  '  '  '' 

Clue  subroutine  *  '  102’  generates  a  set  o£  si  vect 

re  '  '  ■  eral  tatistics  of  :  ng  of  vt  ctors.  Ml  stati  cs  a  re 

acqvd  IV. .  .1  .  Ci  v  cut  -.y  ct  :v.;v  •  •:>»•  tvs'.  =  ever  ..11  v.  .  tors  prcees:  cd. 
'i’be  .... :  t ' •  ;  ro dacoi  ■  iclvde: 


iV.  vjv.i  euv.  ' .  c  veeto 
maximum  mv.  Jcjv  \  cod 


..\  .  r  c  void 


aw  raj  •  > .  r  k  '■  standard  do v5 


\  O0ii"' 


.'v»*r.  ;  o  v.-i'.or  d  •  .  •'  dc\  !.d  .  coci.  ' 


3  tV]'  cm  I  v  (ire.  "os'.  '  ic  is  to  dele  v  v:  •  tec  onvel 

ol  s:ot  o1  ••tors-  of  a  particular  cl  ss.  ;  o.-c  vocte  •:  might  idea  tv 
used  in  a  thr- -hold  deci  sion  rule  classifier. 


f 


— - n 
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3.  3,  (  .  4 _ 'I’’'  rcshold  n  ;sific:  u  ( KLUFK  KLUE04) 

.  -  ■  '  '  “  |] 

Civic  nail  c;  'KlA'ic.i  1  and  hi  LI'  ■  TV.«  implement  a  thro  ’Ll 

decision  rule  classifier.  A  typlc  .l  applicet  h  i  in  to  com n  .  t  ' 

component:;  of  a  set  of  vectors  against  a  liii'h  vector.  The  decision  rule 

is  that  any  single  component  of  the  suspect  voct*  r  p.<ss:  ■  ■  the  Ijn  '  k  t 

(polarity  is  user  specified)  is  called  a  succ<  s;  otherwise  it  is  ;  fai  re. 

1  're requi  i  s  class  labels  may  be  specified  tl  . ;  1  ■  ini  h  ■  .  . .  ’ .  - 

of  a  layered  lecision  rule.  The  d  eisic  cl  be!  ....  . 

for  sucoe  i  or  f  ilure,  or  m  j  be  ft  undisl  I  d  (c.  g. ,  if  teal  fail  , 

don't  change  label).  jj 

I  i  a  typical  e  .perinic.it  ever  :  *l\T  t  YO.Y  ,  •.uc.cler  ce  rds 
'VOU.l  :  he  i'i;  to  ncii  -  the  limit  \  cC.cn  md  test  p;  e'.cr:  .  TcY  woi  Id 

!»c  ’  ’low cd  l”.  a  'KLl  '  '  par...  c.  .h  lo  specife  tl  e  ivee;  .  Lit. 

set  and  printout  fort  desired.  ' ,  . '  .  1  c  .  c i •  :  >  may  bo  printer 

or  simply  ■•..  i  bo  sum:.'.,  ri  ed  in  it  n  ilio:  m  1  -s  (trc.  :  class  vcr. 

‘•cci:  ion.  c..i .  e  ,  or  p v c v iou.:  class  dec:,  ic  .  \  .  .ms  curse.:'  heel,  etc  c’  .  '. 
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3.  3.  t' .  5 


Toil  <’r  Fum  rn\  r.i!  \  (’ll. PEPS) 

Chic  routi  le  ’KLUE05’  is  a  simple  routine  to  issue  a  top  of 
form  or  the  Lii  e  printer  ;  nd  output  ■  li  e  < >f  coi  unent  text.  Thi  ;  faci  Lt\ 
i s  useful  to  sep  rate  printouts  fro  various  clue  r<  i tinei  . 
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3,  3. 8  Operntio  Flowcli 

Tin:  flowchart  i  <:»•  tained  on  th<  followi  lg  two  pages  ( '  ure 
are  intend e  to  illustrate  typical  u  ige  situati*  of  the  softw;  o  module 
described  above. 


3.4  Data  Collection  Procedure 


The  basic  data  collection  procedure  for  Pan  and  Radar  Imagery 

was  to: 

1)  Align  the  frame  area  to  be  sampled  using  the  fiducial 
marks  on  the  film  to  define  the  boundaries  of  the 
sampling  grid. 

2)  Use  the  motorized  film  transport  chip  holder  to 
position  the  imagery  to  the  scan  line  to  be  sampled. 

3)  Record  individual  aperture  OPS  samples  along  the 
scan  line  on  floppy  disk  storage  for  subsequent 
analysis.  (A  unique  designator  code  was  used  to 
identify  the  frame  scan  line  number  and  location  of 
the  aperture  along  the  scan  line. ) 

4)  Use  an  overlay  grid  to  delineate  the  sampling  location 
for  each  sample  in  the  training  set. 

5)  Assign  a  class  label  in  accordance  with  the  software 
procedure  outlined  in  Sections  3.  3.4  and  3.  3.  7. 

This  procedure  was  repeated  for  each  aperture  size. 

The  sampling  grid  overlayed  on  the  imagery  is  shown  in 
Ilgure  3-2.  Table  3-1  summarizes  the  data  collected  by  class  for  radar, 
panchromatic  and  thermal  imagery. 


3.4.2 


Thermal  Image: 


The  thermal  imagery  data  collection  was  generally  similar 
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3.4.2 


--Continued. 


with  the  following  exceptions: 

1)  A  single  line  sampling  grid  was  developed  rather  than 
a  scan  area  sampling  grid.  This  was  because 
individual  scan  lines  were  at  widely  separated  points 
along  the  long  frame  format  of  the  thermal  imagery. 

2)  As  noted  above,  only  a  single  aperture  size  was  used. 

Once  the  data  for  the  sample  areas  was  collected,  the 
processing  procedure  for  the  thermal  imagery  was  the  same  as  for  the 
radar  and  panchromatic. 


■I  u 


_ _ ~ 


4.  0  FEATURE  AND  DECISION  RULE  DEVELOPMENT 

The  overall  development  philosophy  for  both  features  and  the 
decision  rule  was  to  continue  development  to  the  point  that  overall 
probability  of  correct  classification  approached  the  order  of  80%  or 
better.  Additionally,  it  was  desired  that  no  individual  class  percent 
correct  should  be  less  than  about  60%.  It  was  decided  that  once  a  decision 
rule  meeting  these  general  objectives  was  achieved  for  the  2  nun  pan  and 
2  mm  radar,  no  additional  effort  would  be  expended  attempting  to 
significantly  improve  the  decision  results.  Rather,  the  same  algoritluu 
would  be  applied  to  the  4  mm  and  6  mm  samples  of  the  radar  and  panchromatic 
imagery. 

The  rationale  for  tins  approach  is  that  the  prime  objective  of  the 
study  is  to  compare  effects  of  imagery  type  and  aperture  size.  Expending 
effort  to  optimize  an  algorithm  for  a  specific  data  set  in  order  to  achieve 
5  or  10%  better  performance  is  less  valuable  than  understanding  the 
reasons  for  differing  performance  as  a  function  of  aperture  size  and 
imagery  type  for  a  suboptinial  rule. 


4.  1 _ Feature  Analysis 

4.  1.  1 _ Ring  Features 


The  generic  family  of  ring  features  initially  considered  for  the 

S 

panchromatic  film  with  a  2  mm  aperture  is  given  by 

k 

F(j,k;i,  m)  =  ~  *i  (4-1) 

m 

V- 

n=f 

.th 


where  r^  is  the  intensity  from  the  i  ring 
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4. 1. 1 


—  Continued. 


From  this  generic  family,  the  following  specific  features  were  considered: 

r. 


F(j,j;  1,1) 


(4-2a) 


F(j,j;  1,3) 


r. 

3 


n=l 


(4-2b) 


F(j,j;  4,32) 


r. 

32 


n=4 


(4-2c) 


The  basic  presumption  motivating  the  selection  of  ring  features  is  that 
texture  in  the  scene  causes  an  increase  in  spatial  frequency  content  at 
higher  spatial  frequencies  relative  to  the  undiffracted  energy.  Thus 
features  that  compare  the  diffracted  to  undiffracted  energy  or  the  form  of 
the  diffracted  energy  should  be  the  most  useful  for  discriminating  among 
the  various  topographic  classes. 


Analysis  of  the  optical  configuration  shows  that  a  2  mm  Gaussian 
beam  image  spot  on  the  detector  will  have  virtually  all  the  energy  within 
the  first  three  WRD  6400  detector  rings.  With  this  in  mind,  the  region  of 
undiffracted  energy  was  taken  to  be  the  region  contained  within  the  first 
three  rings.  The  region  of  diffracted  energy  was  taken  to  be  the  region 
including  rings  4  through  32.  Thus,  normalization  to  undiffracted  energy 
was  taken  to  be  normalization  to  rings  1  through  3  while  normalization  to 
diffracted  energy  was  taken  to  be  normalization  to  rings  4  through  32. 

Both  of  these  normalizations  were  evaluated  using  the  decision  rule 


4. 1.  1 _ — Continued. 

described  in  the  following  section.  Normalization  to  diffracted  energy  was 
found  to  be  slightly  better  and  therefore  used  as  the  primary  feature  set. 

4.  1. 2 _ Wedge  Features 

4.  1.2.  1  Panchromatic  and  Thermal  Imagery  Wedge  Features 

The  feature  sets  used  for  panchromatic  and  thermal  i^nagery 
are  defined  as  follows: 


Let  w.  ,  i=l,  . . .  ,  32  be  the  intensity  of  illumination  on  the 
.th  1 

1  wedge.  Then 


w 


-  max  w. 

.  l 
i 


(4-3) 


Aw.  = 


w  -  w. 
1+1  1 


wl  ‘  W32 


for  i=l,  . . . ,  31 
for  i=32 


(4-4) 


Let  (s).  i=  1 ,  . . .  ,  n  be  the  i^1  order  statistic  defined  by  the 
relationship 


L 

[ 

L 

t 

[ 


min  s  =  (s)  <  (s)  <...<  (s).  <(s)  <...<(s)  =  max  s.. 

j  1  *  6  X  It  1  n  .  i 


(4-5) 


Then,  the  first  set  of  wedge  features  |f^  j  is  given  by 

or  in  words,  the  ranked  absolute  wedge  differences  normalized 
by  the  maximum  wedge. 
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4.  1.2.  1  --Continued. 


The  second  set  of  wedge  features  F  *8  given  by 

{Fw2}  =  (j(|Aw|)32 

or,  the  ranked  absolute  wedge  differences  normalized  by  the  maximum 
absolute  wedge  difference. 

Note  that  these  families  of  features  are  rotationally  invariant, 
i.  e.  ,  rotational  orientation  of  the  diffraction  pattern  does  not  affect  the 
value  of  the  feature  family.  In  addition,  notice  that  these  features  are 
basically  a  measure  of  the  angular  uniformity  of  the  diffraction  pattern. 
This  measure  of  uniformity  is  not  developed  in  absolute  terms,  but 
rather  relative  to  the  normalizing  factor. 


(4-7) 


4. 1.2.  2  Radar  Imagery  Wedge  Features 


The  best  set  of  wedge  features  used  for  radar  imagery  is  the 

following: 


W 


(i) 

13,20 


(4-8) 


s  Notice  that  this  set  of  features  will  be  sensitive  to  the 

orientation  of  the  diffraction  pattern.  It  was  designed  specifically  for 
the  synthetic  aperture  radar  in  order  to  detect  the  "cross  pattern" 
characteristic  of  specular  returns  from  cornercube-like  objects  on  the 
ground.  These  cross  patterns  will  always  be  oriented  in  the  same 


4. 1.2.2 


--Continued. 


direction  relative  to  the  flight  path  and  therefore  at  a  fixed  angular 
orientation  in  the  imagery.  Thus,  there  is  in  fact  no  loss  in  generality 
in  using  this  type  of  feature. 

This  feature  measures  an  increase  in  diffracted  energy  in  the 
central  wedge  elements  compared  to  the  other  wedge  elements.  It  was 
developed  by  observing  that  a  large  fraction  of  the  aperture  samples  for 
urban  areas  displayed  energy  distributions  on  the  wedges  similar  to  those 
of  Figure  4-1.  On  the  other  hand,  the  majority  of  samples  from  other 
classes  typically  had  a  dip  in  the  center  wedge  elements  and  tended  to  have 
increased  energy  at  the  outer  wedge  elements  compared  to  the  center 
wedge  elements  as  shown  in  Figure  4-2. 

Finally,  the  observation  that  led  to  the  wedge  features  described 
by  Equation  (4-8)  motivated  the  following  wedge  autocorrelation  feature 

set. 

32 

a(w  =  -j-1 —  2  wi  <4-9> 

z2rjl  i=1  k=l, . . . ,  32 

1=1 

where  the  subscript  with  an  overbar,  a ,  is  interpreted  as 

°  =  jjo-1)  mod  32  j  +  1  (4-10) 

Thus  we  have  a  wedge  autocorrelation  function  normalized  by  the 
"undiffracted  energy"  incident  on  rings  one  through  three. 
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4.  1.2 


--Continued. 


This  feature  set  was  not  quite  as  effective  as  jw(i)13  _>0  j,  but 
was  significantly  more  effective  in  identifying  those  sample  apertures 
with  specular  returns  that  typify  urban  areas  than  the  normalized  rings 
F(j,j;4  ,32).  Note  that  the  autocorrelation  form  is  in  fact  rotationally 
invariant  and  furthermore  is  symmetric  about  a  lag  of  15  wedges. 

4,1.3 _ Feature  Evaluation  Methodology 


The  basic  method  used  to  evaluate  the  feature  families  described 
above  was  to  utilize  the  features  in  the  general  decision  rule  structure 
described  in  the  next  section.  Maximum  mutual  information  analysis 
was  used  on  a  limited  basis  to  evaluate  the  ability  of  certain  subsets  of 
the  feature  families  to  separate  particular  classes.  It  was  on  the  basis  of 
just  this  type  of  analysis  that  the  decision  was  made  not  to  differentiate 
between  what  appeared  to  be  plowed  and  non-plowed  agricultural  land. 

No  significant  separation  of  the  two  classes  appeared  to  be  achievable 
with  any  of  the  feature  sets  under  consideration.  In  addition  it  seemed 
quite  difficult  to  visually  justify  the  initial  classification  of  various 
apertures  into  plowed  and  non-plowed. 

4.  2 _ Decision  Rule 


4.  2.  1 _ Motivation 

The  MISTIC  Decision  Rulc,^  ^  is  perfectly  general  in  the  sense 
that  in  principle  it  can  handle  an  arbitrary  number  of  classes  and  feature 
vectors  with  an  arbitrary  number  of  components.  From  a  practical 
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4.  2,  1 _ --Continued. 

standpoint,  2n  samples  would  be  required  in  order  to  utilize  n  components. 
With  four  classes  .  vailable,  and  as  few  as  31  samples  in  some  classes, 
an  upper  limit  of  f  r  component  feature  vectors  is  imposed.  In  cases 
where  the  classes  are  well  separated,  four  components  may  well  be 
sufficient  to  separate  the  four  classes.  In  this  case  here,  it  became 
obvious  after  initial  investigation  of  the  first  data  set  that  effective 
separation  of  the  classes  was  not  to  be  accomplished  using  only  four 
components. 

By  studying  the  envelope  of  the  normalized  ring  values  it  soon 
became  clear  that  the  urban  class  had  the  following  property:  each 
individual  urban  sample  had  a  normalized  ring  value  that  exceeded  the 
maximum  normalized  ring  value  for  each  of  the  other  classes.  This 
property  defines  a  region  in  32-space.  Thus,  given  a  sufficient  number 
of  samples,  the  MISTIC  Decision  Rule  would  accurately  define  this  region. 
However,  a  small  number  of  samples  would  not  be  sufficient  for  the  MISTIC 
Decision  Rule  to  perform  this  characterization.  On  the  other  hand,  a 
decision  rule  which  successively  compared  each  component  from  an 
unknown  sample  to  the  maximum,  minimum,  mean  or  other  selected 
quantile  from  the  distribution  of  another  class  could  in  fact  define  this 
type  of  decision  region  in  a  very  simple  way. 

4.2.  2 _ Decision  Rule  Definition 

Let  class  i  i=l  to  4  be  given  as  follows: 

Class  1  =  Urban 
Class  2  =  Water 
Class  3  =  Agriculture 
Class  4  =  Forest 
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Let  the  regions  i=l  to  5  be  the  regions  where  the  decision  action  is  the 
following: 

-  decide  urban 

A^  -  decide  water 

A^  -  decide  agriculture 

A,  -  decide  forest 
4 

A  -  abstain  from  making  a  decision 

D 


Let  the  generic  feature  vector  for  class  i  be  given  by 
X  =  {Xl»  X2*  •»  Xn  } 


(4-11) 


In  terms  of  the  foregoing,  define  the  region  B.  whose  boundaries 
are  an  upper  bound  on  the  region  containing  all  the  class  i  vectors  as 
follows : 


Bi  =  jx  :  X*  <  Xj  <  x*,  j=l,  . . .  ,  n|,  i=l,  2,  3, . .  . ,  4 

(4-12) 

,  i  min  i 

where  x .  =  ,  x . 

— j  all  vectors  j 

in  class  i 

— i  _  max  i 

Xj  all  vectors  Xj 

in  class  i 
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decision 
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4.2.  3 


Decision  Rule  Properties 


The  decision  rule  defined  in  the  previous  section  has  some  very 
interesting  properties.  Among  these  are: 

1)  The  rule  is  hierarchical  in  nature  and  can  be  represented 
as  a  tree. 

2)  Bounds  on  certain  probabilities  of  misclas sil'ication  can 
be  determined  independent  of  the  underlying  distribution. 
Therefore  there  is  a  nonparametric  aspect  to  this  rule. 

3)  An  abstention  action  exists  but  not  for  all  classes 
uniformly. 

Let  us  now  examine  these  properties  in  more  detail. 

Hierarchical  Nature  -  Figure  4-3  is  a  representation  of  the 
decision  rule.  The  hierarchical  nature  of  the  rule  can  easily  be  seen  from 
this  figure.  In  the  first  stage,  the  urban  class  is  separated  from  the  three 
other  classes.  At  subsequent  levels  in  the  tree,  water,  then  agriculture, 
then  forest  are  separated  from  the  remaining  group.  Those  samples 
remaining  after  the  forest  classification  are  by  definition  the  samples  tliat 
fall  in  the  abstention  region  for  which  no  decision  is  made. 

Nonparametric  Nature  -  The  nonparametric  nature  of  the 
decision  rule  concerns  an  error  bound  for  each  class  that  is  independent 
of  the  underlying  distribution  for  the  particular  class.  To  sec  this, 
consider  the  following: 

Pr  |  Error  |  Class  i  |  =  Pr  {  X  /  A^  |  Class  i  } 

<  Pr  {  X  l  B.  |  Class  i  } 

=  Pr  j  X  :  x.  <  x  *  for  some  j 
J  “  J 

or  x.  >  x  *  for  some  j  f 


(4-14) 
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The  last  probability  is  precisely  the  probability  of  at  least  one 
component  exceeding  the  order  statistic  or  being  less  than  the  1st 
order  statistic  given  n-samplcs.  Determining  these  probabilities  is 
precisely  the  problem  of  determining  the  probability  of  the  first  and 
last  coverage  associated  with  the  order  statistics  |^x !  .  This  can 

be  done  independent  of  the  actual  distribution  of  the  xj  (see  Ref.  2). 

Thus  a  bound  on  the  probability  of  misclas sification  can  be  determined 
without  knowing  the  actual  distribution. 

Abstention  Region  -  The  reject  region  is  defined  as 
A5  =  (A1UA2UA3UA4) 

By  application  of  DeMorgan's  Law  and  the  distributive  property  of 
Boolean  operators,  it  can  be  shown  that 

As=  B3nE4u[sinB2nB3nB4] 

Note  that  this  reject  region  is  defined  only  in  terms  of  the  region  for 
accepting  class  3  and  class  4  simultaneously  or  rejecting  all  classes. 

This  obviously  does  not  limit  samples  from  other  classes  from 
being  in  this  region.  However  the  form  of  the  rule  is  such  that  at  least 
in  the  training  set  no  sample  from  agriculture  or  forest  can  be  misclassified. 
This  is  easy  to  see  from  the  tree  representation  of  the  rule  in  Figure  4-3. 

Any  sample  that  is  outside  of  both  B3  and  B4  is  not,  by  definition,  agriculture 
or  forest.  Thus,  for  members  of  either  of  these  two  classes  only  three 
possibilities  exist.  A  forest  sample  is  only  within  B4;  an  agriculture 
sample  is  only  within  B3;  or  a  sample  from  either  one  is  in  B3  0  B4.  Thus 
either  the  sample  is  correctly  classified  or  falls  in  the  common  region  and 
is  assigned  an  abstention  action. 
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4.  2.  4  Specific  Realizations  of  the  Decision  Rule  for  Panchromatic,  Radar 

and  Thermal  Imagery  Cases 

During  the  course  of  the  analysis,  additional  subclasses  were  defined 
in  order  to  better  understand  the  performance  of  the  decision  rule.  Specifically 
new  water  classes  were  defined  for  the  two  river  regions  in  the  panchromatic 
and  radar  imagery  when  observation  of  the  initial  class  statistics  showed  an 
apparent  grouping  into  two  distinct  groups  of  the  water  samples.  In  the 
panchromatic  imagery.  Water  (50)  texture  appears  nonuniform  compared  to 
Water  (60).  The  reflectance  from  Water  (50)  varies  depending  on  the  distance 
from  the  shoreline.  The  reflectance  from  Water  (60)  appears  constant 
independent  of  the  distance  from  the  shoreline.  In  the  radar  imagery,  the 
distinction  between  the  two  water  classes  is  slight.  Water  (50)  is  not  quite 
as  dark  as  Water  (60),  but  there  is  no  variation  depending  on  distance  from 
the  shore. 

Similarly,  the  initial  objective  was  to  classify  agriculture  into  plowed 
and  non-plowcd  classes.  Therefore  those  class  distinctions  were  carried 
through  tlie  entire  analysis.  Using  the  notation  developed  above,  the  following 
figures  define  the  exact  decision  rules  used  for  the  panchromatic,  radar  and 
thermal  imagery  cases.  Also  indicated  in  each  figure  is  the  form  of  the 
feature  family  used. 


Figure  4-4a.  Decision  Rule  and  Features  for  Panchromatic  Imagery 
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B.,  i  =  1,  2,  3,  4,  5  given  by  Equation  (4-12). 
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Figure  4-4a.  (continued) 


U>  II 


1 


X*  U  B.UB 

1=2  i  1 


X<  u  B.U  (B  n  B  ) 
i=3  1 


Xf  n  B.flArtB, 
i=3  1  1  2 


X*  U  B.U(B  fl  B  OB  ) 

i=4  1  12  3' 


DECIDE  URBAN 


(Aj) 


DECIDE  WATER  60 


(A2> 


DECIDE  WATER  50 


X<  B  U(B  A  B  OB  OB  ) 

d  l  6  .3  4 


DECIDE  AGRICULTURE 


A.  =  B  AB  U 
,  J  4  5 

•>  x  X 


Figure  4-4b.  Decision  Rule  and  Features  for  Radar  Imagery 
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Figure  4-4b.  (continued) 
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Figure  4-4c.  Decision  Rule  and  Features  for  Thermal 


Imagery 
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5.  0 _ QUANTITATIVE  STATISTICAL  EVALUATION  OF  DECISION 

RESULTS 


5.  1 _  Statistical  Formulation  of  the  Study  Questions 


The  general  question  posed  by  this  study  is:  What  difference 
in  terrain  decision  performance  is  there  (if  any)  for  optical  power 
spectrum  analysis  of  panchromatic,  radar  and  thermal  imagery? 
Referring  to  the  experiment  design  (Figure  3-1),  this  broad  question 
may  be  framed  as  several  more  specific  questions: 

1)  Are  the  overall  decision  results  different  when 
comparing  2  mm  sampled  panchromatic  to  2  mm 
sampled  radar  to  10  mm  sampled  thermal 
(equivalent  to  2  mm  when  scale  is  taken  into 
account)  ? 

2)  Considering  the  portion  of  the  experiment  design 
comparing  panchromatic  and  radar  imagery 
sampled  with  identical  apertures: 

a)  Is  the  overall  decision  performance  different 
for  panchromatic  and  radar  imagery  when  all 
aperture  sizes  are  taken  into  account? 

b)  Is  there  a  significant  difference  between  the 
ability  to  recognize  specific  terrain  types  for 
panchromatic  imagery  compared  to  radar? 

c)  Does  aperture  size  affect  overall  decision 
performance  or  performance  for  any 
particular  terrain  type  independent  of  imagery 
type. 


"T"-.  I  !■ 


r 


3)  Does  aperture  size  affect  the  decision  performance  for 
panchromatic  imagery?  For  radar  imagery? 

5.  2 _ Statistical  Framework 


Two  statistical  tests  can  be  used  to  answer  all  of  the  questions 

above.  Questions  1  and  3  are  answered  by  applying  a  form  of  the  X~  Test'  ' 

to  test  for  the  equality  of  two  multinomial  distributions  with  unknown 

subgroup  probabilities.  An  analysis  of  variance  based  on  a  linear  hypothesis 

(2) 

model  is  used  to  develop  the  answers  to  question  2. 

5,  2.  1 _ Chi  Square  Test  for  Multinomial  Equivalence 

Considered  two  independent  multinomial  distributions  with 
parameters  given  as  follows: 

n.,  Pj.,  P2j,  Pkj,  j  =  1,2 

i=l,  2,  ...»  k  ,  j  =  1,  2  (5-1) 

the  corresponding  observed  frequencies 
If  n^  and  n0  are  large,  then  the  random  variable 
'■'S  2  k  2 

X2  .  E  E  lxii-nipii)  (5-2) 

j=l  i=l  n.p.. 

J 

is  a  sum  of  two  stochastically  independent  random  variables 
each  chi  square  with  k- 1  degrees  freedom.  Therefore  in 
the  limit  as  n^  and  n.,  approach  infinity,  approaches  a 
chi  square  random  variable  with  2k-2  degrees  freedom. 
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5.  2.  1 


--Continued. 


The  two  multinomial  distributions  will  be  identical  if 
Pll  =  pJ2,  p^j  =  an<^  so  on-  Thus,  the  null 

hypothesis  is  given  by 


H0:  P11  "  P12’  P2 1  P22*  ‘  '  Pkl  Pk2 

with  each  p  =  p  (5-3) 

i  =  1,2,  ...  ,  k  unspecified. 


Since  the  subgroup  probabilities  are  unknown, 

use  a  maximum  likelihood  estimate  for  p._  =  p 

ll 

by 


we  may 
i2  given 


A 

P; 


=  (x, 


il 


v/(ni 


+  n2) 


l—  1,  2,  ...,  k 


(5-4) 


When  this  estimate  is  substituted  into  equation  (5-2) 
we  get  the  following  statistic 


~  2 
*  =  22 

k 

E 

-ih'wvl! 

j=i 

i=l 

n.  1 
J  1 

*  V/("l  +  ”2>] 

(5-5) 


This  random  variable  approaches  a  chi  square 

distribution  with  k-1  degrees  of  freedom.  Notice 

2 

that  when  n^  =  n^  =  n,  the  expression  for  X  simplifies 

to 


k 

Z 

i=l 


*  2  <Xil 


+  V  } 


(l/2)(x 


(5-6) 
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5.2.  1.2 


plications  of  the  Chi  Square  Multinomial  Test 


When  a  decision  rule  is  applied  to  a  set  of  data  samples,  each 

sample  within  the  set  is  assigned  to  a  particular  class.  This  effects  a 

partition  of  the  data  samples  in  various  subgroups.  The  probability  of 

observing  a  given  number  in  each  subgroup  corresponds  to  a  particular 

realization  for  the  X..  in  equation  (5-1).  In  general,  the  p..  are  determined 

ij 

by  the  prior  probability  of  a  given  class  occurring  as  well  as  the 

performance  of  decision  rule.  Assuming  that  the  only  effect  on  the  true 

p  .  is  the  effect  of  the  decision  rule,  then  if  we  reject  the  null  hypothesis, 
ij 

Hg,  at  a  suitably  low  significance  level,  we  have  made  a  statistically 
significant  statement  that  the  results  of  the  two  decision  making  operations 
are  not  equivalent.  Specific  applications  of  this  test  will  be  discussed  in 
Section  5.3. 


5.  2.  2 _ Analysis  of  Variance  for  the  Linear  Hypothesis  Model 


5.2.2.  1 


Test  Description 


Consider  a  random  process  in  which  two  effects  operate  on 
the  random  variable.  For  each  effect,  we  wish  to  determine  if  a  statistically 
significant  variation  in  the  observed  value  has  been  caused  independent  of 
the  other  effect.  Specifically  in  our  case,  we  have  two  effects  on  the  decision 
results: 

1)  radar  or  panchromatic  imagery,  and 

2)  aperture  size  (2,  4  or  6  mm  Gaussian  beam). 


Suppose  we  labeled  the  columns  2,  4  and  6  and  the  rows  pan 
and  radar.  We  could  choose  as  the  entries  the  overall  probability  of 
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5.  2.2.  I 


--Continued. 


correct  classification  for  the  specific  ease,  i.  c. ,  2  mm  pan,  4  mm  radar, 
etc. 


In  general,  we  may  develop  the  following  model.  Assume  a 
matrix  with  a  rows  and  b  columns.  For  each  row  one  of  the  treatments 
is  held  constant  and  for  each  column  the  other  treatment  is  held  constant. 
Denote  each  entry  in  the  table  by  X„  and  the  mean  value  of  these  entry 
random  variables  as  LI...  We  may  now  write  ju..  as 


f'ij  +  “i  +  Pi 


(5-7) 


Wc  thus  basically  wish  to  test  the  hypothesis  that  the  0. 

arc  all  individually  zero  -  or  the  results  by  row  are  not  different.  For 

the  second  treatment  we  wish  to  test  whether  or  not  the  L>.  are  all 

J 

individually  zero  -  or  results  from  column  to  column  are  the  same.  An 
analysis  of  variance  procedure  is  used  to  compare  the  row  or  column 
variation  to  the  variation  of  the  entries  with  respect  to  the  overall  mean 
value. 


This  model  assumes  the  following  key  properties: 

1)  The  row  effects  and  column  effects  are  additive  as 

shown  in  equation  (5-7). 

The  are  independent  normally  distributed  random 
variables  each  with  identical  variance  0*  . 
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5.  2.2.  1 


—  Continued. 


It  is  not  clear  exactly  how  the  effects  of  aperture  size  and  imagery  type 
combine.  Thus,  at  least  at  this  stage  of  the  game  the  additive  assumption 
is  as  good  as  any  other.  A  fairly  strong  case  can  be  made  that  the  second 
assumption  is  satisfied.  The  entries  are  the  results  of  independent 
experiments  so  that  in  fact  the  decision  results  from  one  experiment 
should  be  independent  of  those  for  another.  Since  the  entries  are 
estimates  of  probabilities  of  error,  correct  or  reject,  they  are  the 
result  of  a  sum  of  Bernoulli  trials.  This  sum  for  sufficiently  large  N  is 
very  well  approximated  by  the  normal  distribution.  Under  the  null 
hypothesis  that  there  is  no  column  or  row  effect,  all  the  variances  will 
be  identical.  They  are  estimates  of  the  same  random  variable  which 
follows  a  binomial  distribution  with  variance  np  (1  -  p). 


With  the  foregoing  in  mind,  it  can  be  shown  that  the  null 
hypothesis  H^:  =  0  (j=l,  .  .  .  ,  b)  can  be  tested  using  the  right  tail  of 

the  F-distribution  as  a  critical  region  where  the  following  F- statistic  is 
used. 


col 


where. 


I*-1’  ill  £  <X-  v  ~  X> 

•I,  (Xij  -  5|.  -  Xj-  +  X> 


a 

X 

i=l 


X)2 


X.  •  is  the  column  mean 

rr  .  ..  .th 

Xj.  is  the  l  row  mean 

X  is  the  overall  entry  mean 

Pj  =  b-1  and  V  =  (a-l)(b-l) 


(5-8) 
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5.2.2.  1 


—  Continued. 


Similarly,  the  null  hypothesis  that  assumes  the  row  means  to  be  equal, 
HqS CL  =  0  (i=l,  ...»  a)  may  be  tested  using  the  right  tail  of  the  F - 
distribution  as  a  critical  region  where  the  F- statistic  is  computed  using 


F 

row 


b  a 

lb-1)  g  g,  (X.  -.X)2 

i  z(V\  -Vx)2 

i=i  j=i 


(5-9) 


where  =  a- 1  andl^  =  (a.-  l)Cb— 1 ) 


5.  2.  2.  2  Applications  of  the  Linear  Hypothesis  Model  Analysis  of 

Variance 

In  our  case,  the  two  effects  we  wish  to  test  are: 

1)  the  effect  of  the  radar  or  panchromatic  sensor  data 
source  on  decision  performance 

2)  the  effect  of  aperture  size  on  decision  performance 

By  applying  the  analysis  of  variance  procedure,  we  will 
determine  if  the  results  obtained  differ  in  a  statistically  significant  way 
for  radar  versus  pan  independent  of  aperture  size  and  whether  independent 
of  sensor  type  aperture  size  is  a  significant  factor  influencing  decision 
performance.  Various  measures  of  performance  will  be  investigated. 
These  will  include  probability  of  correct  classification,  probability  of 
incorrect  classification,  and  probability  of  abstaining  from  a  decision  for 
all  classes  and  for  classes  individually  considered. 


Discussion  of  Results  -  Statistical  Answers  to  the  Study 
Questions 


5.  3 


5.  3.  1 _ Confusion  Matrices 

The  confusion  matrices  for  the  eight  different  cases  represented 
in  the  experiment  design  tree  of  Figure  3-1  are  presented  in  Tables  5-1 
through  5-8.  For  the  pan  and  radar  imagery,  the  data  was  classified  into 
six  classes: 

*  Urban  -  class  10 

*  Water  -  class  15 

*  Water  -  class  60 

*  Plowed  Agriculture  -  class  20 

*  Non-Plowed  Agriculture  -  class  70 

*  Forest  -  class  40 

Decision  actions  developed  from  the  decision  rule  described 
in  Section  4.  2  were: 

*  10  -  decide  in  favor  of  urban 

*  50  -  decide  in  favor  of  water  50 

*  60  -  decide  in  favor  of  water  60 

*  80  -  decide  in  favor  of  agriculture 

*  40  -  decide  in  favor  of  forest 

N 

*  90  -  abstain  from  a  decision 

Two  classes  of  water  were  maintained  both  in  the  description 
of  the  data  samples  and  for  the  decision  actions  because  the  two  samples 
of  water  available  in  the  data  set  appeared  quite  different  visually. 
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TABLE  5-1.  CONFUSION  MATRIX  1MM  PAN  HARD  CLIPPED 


TABLE  5-2.  CONFUSION  MATRIX  2 MM  PAN  GAUSSIAN 
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TABLE  5-3.  CONFUSION  MATRIX  4MM  PAN  GAUSSIAN 
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TABLE  5-4.  CONFUSION  MATRIX  6MM  PAN  GAUSSIAN 


TABLE  5-6.  CONFUSION  MATRIX  4MM  RADAR  GAUSSIAN 


5.  3.  I 


-  -  Continued. 


Initial  decision  results  indicated  significant  differences  in  the  two  types  of 
water  involved.  15oth  plowed  and  non-plowed  agriculture  were  designated 
as  separate  classes  initially  in  order  to  determine  if  accurate  separation 
of  these  two  classes  was  possible.  For  the  panchromatic  and  radar  data 
sets  it  was  quite  difficult  visually  to  determine  whether  or  not  a  field 
was  plowed.  Tlius  there  was  some  question  in  the  ground  truth  assignment 
for  these  two  classes.  Since  the  ground  truth  assignments  were  suspect 
and  initial  results  indicated  no  clear  distinctions  between  the  two  classes, 
only  a  single  agriculture  decision  class  was  used  in  the  subsequent 
experiments. 

In  addition  to  the  number  entries  in  the  confusion  matrix, 
summaries  by  class  of  the  percent  correct,  percent  error  and  percent 
abstain  arc  listed.,  The  overall  percentages  are  obtained  by  averaging 
tlic  values  for  each  class  equally.  Thus,  for  example,  in  Table  5-1  the 
overall  probability-  of  correct  percent  equal  to  68.  1  is  obtained  by 
averaging  93.  5,  (45.4  X  11  +  7.  6  X  26) /37  =  18.  8,  (73.4  X  83  i  64.  5  X  48) /1 31 
=  70.  1  and  90.  1 . 

5.  3.  2 _ Comparison  of  Panchromatic ,  Radar  and  Thermal  Imagery 

Decision  1  erl'ormance 

The  chi  square  test  for  equivalence  of  multinomial 
distribution  was  vised  to  compare  the  decision  performance  for  panchromatic, 
radar  and  thermal  imagery.  Three  pairs  of  comparisons  are  used: 

1)  2  mm  pan  versus  2  mm  radar 
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5.  3.2 


--Continued. 


2)  2  nun  pan  versus  10  mm  thermal 

3)  2  mm  radar  versus  10  mm  thermal 

These  comparisons  are  for  aperture  sizes  that  include  approximately 
the  same  ground  area.  The  comparisons  are  based  on  the  number  of 
samples  the  decision  rule  assigns  to  each  decision  class. 

In  order  to  allow  a  comparison  with  the  thermal  imagery 
which  contains  only  a  single  water  class,  water  50  and  water  60  are 
combined  into  a  single  class  for  both  the  pan  and  radar  imagery.  In 
addition,  the  number  of  samples  in  each  decision  class  normalized 
relative  to  the  number  of  time  samples  in  that  particular  class.  In  order 
to  get  a  comparable  set  of  frequency  observations,  the  percentages  are 
multiplied  by  the  number  of  samples  in  the  class  for  pan  imagery.  Thus 
in  this  sense  observations  are  normalized  to  the  pan  imagery. 

Table  5-9  contains  the  normalized  frequency  observations 
for  the  three  comparisons.  Also  indicated  in  each  case  is  the  value  of 
the  chi  square  variable  computed  from  the  data  and  how  this  value 
compares  to  the  ll!'u  significance  level.  We  notice  that  in  all  three  cases 
the  value  of  the  chi  square  variable  exceeds  the  1%  significance  level. 
Thus  we  can  conclude  that  the  performance  is  different  for  pan,  radar 
and  thermal. 

If  we  use  the  chi  square  variable  as  a  measure  of  closeness 
of  performance,  we  note  that  the  performance  for  pan  and  thermal  is 
closest  with  a  chi  square  value  of  14.  3.  Ne..t  is  radar  versus  thermal 
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Table  5-9*  Pan/Radar/Thermal  Decision  Performance  Comparison 


a)  Pan  versus  Radar 


Decision  Class 

Label 

U  rban 

Water 

Agriculture 

Forest 

Ambiguous 

(10) 

(50) 

(80) 

(40) 

(90) 

2  mm  Pan  ( 1 ) 

31 

32 

83 

161 

106 

2  mm  Radar  (2) 

24 

32 

111 

20? 

39 

X2  = 

41. 19  > 

13.  3  (1%  significance  level) 

Pan  versus  Thermal 

Decision  Class 

Label 

U  rban 

Water 

Agriculture 

Forest 

Ambiguous 

(10) 

(50) 

(80) 

(40) 

(90) 

2  mm  Pan 

31 

32 

83 

161 

106 

10mm  Thermal  (3) 

29 

23 

66 

214 

81 

x2  = 

14. 31  > 

13.  3  (1%  significance  level) 

Radar  versus  Thermal 

Decision  Class 

Label 

U  rban 

Water 

Agriculture 

Forest 

Ambiguous 

(10) 

(50) 

(50) 

(40) 

(90) 

2  mm  Radar 

24 

32 

111 

207 

39 

10mm  Thermal 

29 

23 

66 

214 

81 

II 

28.  2  >  13.  3  (1%  significance  level) 

(1)  Actual  number  of  decision  samples. 

(2)  Number  of  decision  samples  chosen  to  be  the  fraction  of 
Pan  samples  closest  to  the  actual  fraction  of  Radar  samples, 
c.  g.  20/26  =  24/31  for  Urban. 

(3)  Number  of  decision  samples  chosen  to  be  the  fraction  of  Pan 
samples  closest  to  the  actual  fraction  of  Thermal  samples, 
e.  g.  59/64  =  29/31  for  Urban. 
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with  a  chi  square  value  of  28.  2.  Finally  the  two  which  appear  to  differ 
the  most  are  pan  and  radar  with  a  chi  square  value  of  41.2.  Thus,  in  a 
semiquantitative  way  we  can  conclude  that  at  least  insofar  as  the 
application  of  optical  power  spectrum  analysis  for  terrain  classification, 
panchromatic  and  thermal  imagery  will  have  performance  characteristics 
that  are  closer  than  panchromatic  and  radar  or  thermal  and  radar  imagery. 

5.  3.  3 _ Detailed  Comparison  of  Panchromatic  and  Radar  Imagery 

5,  3.  3.  1  Application  of  the  Linear  Hypothesis  Model  Analysis  of 

Variance 

Analysis  of  variance  of  the  linear  hypothesis  model  was 
used  to  examine  the  effect  of  sensor  type  (radar  or  panchromatic)  and 
aperture  size  on  the  decision  performance  for  all  classes  and  for 
particular  terrain  types.  For  example,  the  decision  action  average 
percent  correct,  percent  error  and  percent  reject  may  be  formed  into 
2X3  linear  hypothesis  model  tables  as  shown  in  Table  5-10.  The  rows 
in  each  case  contain  the  value  for  a  particular  sensor  type  at  each  of 
the  three  common  aperture  sizes  2,  4  and  6  mm.  The  column  F-value 
is  a  measure  of  the  variation  due  to  aperture  size  independent  of  sensor. 

On  tlie  other  hand,  the  row  F-valuc  is  a  measure  of  the  effect  of  sensor 
type  independent  of  aperture  size. 

Tables  similar  to  5-10  were  constructed  using  the  percent 
correct,  percent  error  and  percent  reject  for  each  of  the  terrain  classes. 
These  tables  are  presented  in  Appendix  1.  A  summary  of  the  F  test 
values  obtained  from  these  tables  is  presented  in  Table  5-11.  Note  that 
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Tabic  5-10.  Linear  Hypothesis  Model  Analysis  of  Variance  for  All  Class 

Pe  r  for  in  a  lice 


Aperture  /Type  /Imagery 

%  Correct 

°'o  Error 

°'o  Abstain 

1mm  Hardclipped  Pan 

68.  1 

21.8 

9-8 

2mm  Gaussian  Pan 

80.  6 

2.  6 

16.6 

4mm  Gaussian  Pan 

7Q.  5 

8.  2 

18.  5 

6mm  Gaussian  Pan 

77.  5 

10.  1 

12.  2 

2mm  Gaussian  Radar 

85.  2 

5.  6 

9.0 

4mm  Gaussian  Radar 

84.  0 

12.  0 

3.  0 

6mm  Gaussian  Radar 

91.  3 

5.  5 

3.  0 

Pan 

80.  6 

70.  5 

77.  5 

F  =2.01 

col 

Radar 

85.  2 

84.0 

91. 3 

F  =12.4 

row 

2 

%  Correct 

4 

6 

Pan 

2.  6 

8.  2 

10.  1 

F  =1.7 

col 

Radar 

5.  6 

12.  0 

5.  5 

F  =7.5 

row 

O' 


/o  Error 


Pan 

Radar 


2  4  6 


16.  6 

18.  5 

12.2 

9.  0 

3.  0 

3.  0 

To  Abstain 


col 


F 

row 


1.6 

19.  9 
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Table  5-11.  Linear  Hypothesis  Model  Analysis  of  Variance  Summary 

F -Value  (  =  1,  ^  =  2) 

(5%  significance  level  =  18.  5,  1%  significance  level  =  98.4) 


Pan  versus  Radar 

%  Correct 

%  Error 

%  Reject 

All  classes 

12.  4 

7.  5 

19.9 

U  rban  (10) 

17.  28(1) 

120.  86(2) 

1.  0 

Water  (50) 

171  -  96(Z) 

5.86 

1.0 

Water  ( 6 0) 

6.  5 

1.9 

2.  8 

Agriculture  Plowed  (20) 

14. 4(3* 

- 

14.  2<3> 

Agriculture  Non- plowed  (70) 

2174<2> 

m 

2172^ 

Forest  (40) 

22.  4 

22.4 

F -Value  {  i/j  =  Z,  =  2) 

(5%  significance  level  =  19.  0,  1%  significance  level  =  99.  0) 


Aperture  Size 

%  Correct 

%  Error 

%  Reject 

All  classes 

2.  08 

1.7 

1.6 

Urban  ( 1 0) 

0.  8 

2.  9 

1.0 

Water  (50) 

17.  0(4) 

0.  1 

1.0 

Water  (60) 

3.  3 

1.5 

1.  0 

Agriculture  Plowed  (20) 

3.4 

- 

3.4 

Agriculture  Non- plowed  (70) 

392.  6^ 

- 

392. 2{5) 

Forest  (40) 

1.4 

- 

1.3 

1.  Close  to  rejecting  at  the  5%  significance  level  the  hypothesis  that  Pan  and 
Radar  yield  the  same  results. 

2.  Reject  the  hypothesis  at  the  1%  significance  level  that  Pan  and  Radar  yield 

the  same  results. 

3.  Large  F  value  but  not  sufficient  to  reject  the  hypothesis  that  Pan  and  Radar 
yield  the  same  results. 

4.  Close  to  rejecting  the  hypothesis  at  the  5%  significance  level  that  results  arc 
independent  of  aperture  size. 

5.  Reject  the  hypothesis  at  the  1%  significance  level  that  results  arc  independent 
of  aperture  size. 
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for  tiic  row  comparison,  i.c.,  pan  versus  radar,  the  5%  significance 
level  is  18.  5  and  the  1%  significance  level  is  98.  5.  For  the  column 
comparison,  i.c.,  aperture  size,  the  5°o  significance  level  is  19.0  and 
the  1  %  significance  level  is  99.  0.  Because  of  the  form  of  the  decision 
rule,  it  is  impossible  for  an  error  to  occur  when  the  true  class  is 
agriculture  or  forest  in  the  training  set.  Thus,  the  F  value  in  this  case 
is  indeterminate.  This  is  indicated  by  a  dash  in  the  appropriate  entry 
position  in  Table  5-11. 

5.  3.  3.  1 _ Statistically  Significant  Bitterer ces  Between  Fan  and  Kad. t r 

Independent  of  Aperture  Si.  e  and  of  Aperture  Sire  Independent 
of  1  'an  or  Rada r 

The  statistically  significant  differences  between  pan  and  radar 

arc: 

1)  urban-percent  error  ( 1  %  significance  level) 

2)  water  (50)-percent  correct  ( l'’o  significance  level) 

3)  non-plowed  agriculture  (70)-percent  correct  and 
percent  reject  ( 1 l] o  significance  level) 

4)  all  classes-pcrcent  reject  (5<’!>  significance  level) 

5)  forest-percent  correct  and  percent  reject  (5% 
significance  level) 

We  may  thus  conclude  that  in  general  independent  of  aperture  sire  there 
is  a  statistically  significant  difference  in  the  performance  using  optical 
power  spectrum  analysis  for  the  two  cases:  synthetic  aperture  radar 
sensor  and  panchromatic  image  sensor. 
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We  also  note  from  Table  5-11  that  although  not  statistically 
significant  at  even  the  5%  level,  a  fairly  substantial  F  value  is  obtained 
for  urban  percent  correct  and  plowed  agriculture  percent  correct  and 
percent  reject.  On  the  other  hand,  even  though  there  are  large 
differences  in  moan  performance  values  for  water  (60)  between  the 
panchromatic  and  radar  sensor  independent  of  aperture  sire,  this 
difference  is  not  statistically  significant.  This  is  due  to  the  fact  that 
there  is  also  significant  variation  between  aperture  si.  es  for  water  (60). 
Thus  in  comparison  to  the  variation  between  apertures,  the  variation 
due  to  sensor  type  is  not  significant. 

From  Table  5-11  the  only  statistically  significant  difference 
between  apertures  independent  of  sensor  type  is  for  non-plowod 
agriculture  (TO).  The  percent  correct  and  percent  reject  values 
resulting  in  F-test  values  of  39-.  6  and  39-.  1  respectively  differ  at  the 
1%  significance  value.  This  result  is  intuitively  appealing  because  it 
indicates  that  independent  of  sensor  type,  performance  on  a  terrain 
type  having  relatively  less  texture  is  improved  as  the  aperture  sire 
inc reases. 

5.  3,  4 _ Effect  of  Aperture  Si.  e  for  Vanchromntie  and  Radar  Imagery 

N  2 

5,  3.  4,  1 _ Application  of  the  \‘  Test  for  Multinomial  Equality 

The  clii  square  test  for  the  equality  of  multinomial 
distributions  was  used  to  test  the  effect  of  aperture  si.-.e  on  performance 
for  panchromatic  imagery  and  radar  imagery  independently.  For  example. 
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to  determine  if  tlu'  results  for  the  1  nun  hare,  clipped  aperture  were 

different  than  the  results  for  the  2  mm  Gaussian  aperture  applied  to 

» 

panchromatic  imagery,  \'  was  computed  using  equation  (5-o)  and  the 
data  given  in  Table  5- Id.  The  value  obtained,  -11.7,  is  greater  than 
15.  1,  the  1'.'  significance  level.  Therefore  we  may  reject  the  hvpothesis 
that  the  distribution  of  decision  actions  is  the  same  for  the  1  mm  and 
2mm  cases.  In  other  words,  decision  results  are  different  for  the  1mm 
and  2mm  aperture  eases  at  the  l'”.>  significance  level.  The  remainder  of 
the  tables  developed  for  the  chi  square  test  are  in  Appendix  2. 

h  Statist  icaliv  Significant  differences  Pepending  on  Veerture  Si  e 

A  summary  of  the  results  from  these  tables  is  in  Table  5-13. 
The  six  possible  pairings  of  1  mm,  2  mm,  -1  mm  and  o  mm  panchromatic 
aperture  cases  were  investigated.  In  certain  situations  as  noted,  a 
single  decision  class  such  as  water  60  or  a  pair  of  decision  classes 
such  as  forest  -10  .uni  abstain  in  combination  caused  the  \  value  to 
exceed  the  significance  level. 

In  the  case  of  the  1  mm  aperture  versus  the  -l  mm  aperture, 

> 

forest  ami  abstain  were  combined  in  a  single  class  and.  the  \  value 
recomputed.  In  tin;  iso,  no  significant  difference  between  the  two 
aperture  sires  is  developed  based  on  the  \  value.  Thus,  the  conclusion 
is  that  the  difference  between  the  1  nun  hard  clip  and  tlio  4  mm  Gaussian 
is  due  to  the  relative  diffraction  pattern  signatures  of  forest  and 
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Table  5-12.  X  Test  Comparing  Panchromatic  1mm  Ilarclipped  Aperture 
Results  to  2mm  Gaussian  Results 


Decision  Action 


Aperture  Size 

U  rban 

10 

Water 

50 

Water 

60 

Agriculture 

80 

F  orcst 

40 

Abstain 

90 

1  mm 

29 

5 

2 

98 

219 

60 

2nvm 

31 

9 

23 

83 

161 

106 

i_ 

(Xil  +  Xi2)/2 

1  ^"2 

-^(Contribution  to  X  ) 

1 

30.  0 

.  03 

2 

7.  0 

.  57 

3 

12.  5 

8.  82 

4 

90.  5 

.62 

5 

190.  0 

4.42 

6 

83.  0 

6.  37 

2 

X  =  41.69  >15.1  (1%  significance  level) 
(See  Equation  5-6) 
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Table  5-13.  Aperture  Comparison  -  X  Test  R-esults  Summary 
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agriculture  since  these  classes  determine  the  decision  boundaries  between 
forest  and  abstain.  A  similar  analysis  for  the  2  mm  versus  4mm  and 
4mm  versus  6  mm  shows  that  assuming  that  all  water  60  samples  were 
correctly  classified  in  one  or  both  of  the  aperture  cases  yields  a 
distribution  of  decision  actions  that  is  not  statistically  significantly 
different  for  the  two  aperture  sizes. 

The  aperture  comparisons  are  summarized  in  Table  5-14, 
which  shows  the  comparisons  between  1,  2,  4  and  6mm  apertures  for 
panchromatic  imagery.  The  entries  in  the  table  indicate  the  significance 
level  at  which  the  decision  action  distributions  differ  according  to  the 
chi  square  test  for  multinomial  distribution  comparison.  In  the  case 
where  no  statistically  significant  difference  exists,  the  entry  none  appears 
in  tiie  table.  Where  appropriate,  an  indication  is  made  to  denote  the 
cause  of  the  difference  between  apertures. 

A  similar  analysis  comparing  2,  4  and  6  mm  results  for 
radar  imagery  shows  no  statistically  significant  difference,  even  at  the 
5%  significance  level,  between  the  distributions  of  decision  actions  for 
the  various  aperture  sizes.  The  test  tables  for  this  analysis  arc 
presented  in  Appendix  3. 

5.  4  Summary  of  Statistically  Significant  Results 

We  arc  now  in  a  position  to  answer  in  a  statistically  quanti¬ 
tative  way  the  three  questions  posed  at  the  beginning  of  tliis  section.  We 
do  tliis  next  as  a  summary  of  the  results. 
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Table  5-1*1.  Aperture  Performance  Comparison  Summary  for  Panchromatic 

Imagery 


1 

2 

4 

6 

1 

- 

1  Of 

1  JO 

2  5"'^) 

None 

2 

- 

jo' (2) 

l/o 

1% 

4 

- 

!>  /o 

6 

- 

X  Significance  Level  Indicating 
Performance  Difference 


(1)  Because  distinction  between  Agriculture  and  Forest  is  not  as  well 
defined  for  4mm  aperture. 


(2)  Due  to  Water  (60). 

(3)  Due  to  Water  (60). 
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Question  1:  Arc  the  decision  results  for  panchromatic,  radar  and  thermal 
imagery  different? 

The  answer  to  this  question  is  yes.  Specifically  using  the 
chi  square  test  for  multinomial  distribution  equivalence,  we  have  the 
following  based  on  a  comparison  of  the  decision  action  distributions: 

2 

1)  Panchromatic  versus  radar  -  X  =41.  2  >13.  3  = 
the  1%  significance  level 

/NX 

2 

2)  Panchromatic  versus  thermal  -  X  =  14.3  >  13.3  = 

1%  significance  value 

A- 

2 

3)  Radar  versus  thermal  -  X  =  28.  2  >  13.  3  = 

1%  significance  level 

Question  2;  What  does  a  detailed  comparison  of  panchromatic  and  radar 
imagery  show  insofar  as:  (1)  overall  decision  performance, 

(2)  discrimination  between  various  terrain  types,  (3)  effect 
of  aperture  size 

With  respect  to  overall  decision  performance,  the  analysis 
of  variance  of  the  linear  hypothesis  model  comparing  panchromatic  and 
radar  imagery  across  aperture  sizes  shows  that  the  percent  reject  for 
radar  and  panchromatic  is  different  at  the  5%  significance  level.  Thus, 
there  is  a  statistically  significant  difference,  although  not  as  strong  as 
it  might  be,  between  the  overall  decision  performance  for  panchromatic 
and  radar  imagery. 
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I 

5.  4 

The  difference  in  performance  is  stronger  for  specific 
terrain  types.  In  particular,  the  analysis  of  variance  for  the  linear 
hypothesis  model  yields  the  following  results: 

1)  Urban-percent  error  differs  from  panchromatic  to 
radar  independent  of  aperture  si.  e  at  the  T!u 
significance  level. 

*•)  Water  (f>0)-percent  correct  differs  from  panchromatic 

to  radar  imagery  independent  of  aperture  at  t lie 
level. 

.1)  Agriculture  ( 7 0)-pe rc ent  correct  anil  percent  reject 

differ  from  panchromatic  to  radar  imagery  at  the 
1%  significance  level. 

•1)  Forest-percent  correct  and  percent  reject  differ 
from  panchromatic  to  radar  imagery  independent 
of  aperture  at  the  S1!  significance  level. 

Kxamination  of  the  effect  of  aperture  independent  of 
panchromatic  or  radar  sensor  type  shows  a  significant  difference  using, 
analysis  of  variance  on  the  linear  hypothesis!  model  on.lv  for  agriculture  (70). 
In  particular  the  percent  correct  and  percent  reject  are  different 
independent  of  panchromatic  or  radar  as  a  function  of  aperture  sire  at 
the  1%  significance  level. 

Question  a:  Poes  aperture  si.  e  affect  pe  r  fo  rma  nee  of  panchromatic  and 

r.ula  r  imagery  im liv  idually  * 


5.4 
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As  shown  in  Table  5-14,  there  are  significant  differences 
between  the  performance  on  panchromatic  imagery  for  different  aperture 
sizes.  In  three  of  the  five  cases  where  such  differences  exist,  the 
difference  is  attributable  primarily  to  the  decision  results  for  a 
particular  class  or  pair  of  classes.  There  is  no  statistically  significant 
(at  the  5%  significance  level  or  better)  difference  between  the  performance 
utilizing  different  aperture  sires  on  radar  imagery.  We  shall  see  however 
in  the  next  section  that  although  the  number  of  decisions  remains  unchanged 
for  radar  when  comparing  the  2  mm  to  6  mm  case  for  water  (60),  the 
diffraction  pattern  signatures  are  quite  different. 
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COMPARISON  OF  RESULTS  FOR  INDIVIDUAL  SAMPLES 


6.  0 


The  quantitative  discussion  in  the  last  section  treats  the 
decision  performance  from  a  macroscopic  statistical  viewpoint.  In 
this  section  individual  OPS  samples  will  be  compared  in  order  to 
point  out  in  a  qualitative  way  differences  that  may  be  expected  in 
diffraction  pattern  signatures  when  different  sensors  are  vised. 

Because  samples  were  taken  over  identical  areas  using  the  panchromatic 
and  radar  sensors,  we  will  limit  the  discussion  in  this  section  to 
comparisons  of  results  obtained  using  radar  and  panchromatic  imagery. 
The  specific  comparisons  we  will  consider  are: 

1)  classification  of  urban  vising  radar  and  panchromatic 
with  a  2  mm  aperture 

2)  classification  of  water  (50)  vising  radar  and 
panchromatic  imagery  and  a  2  mm  aperture 

3)  classification  of  forest  using  radar  and  panchromatic 
imagery  with  a  2  mm  aperture 

4)  classification  of  non-plowed  agriculture  utilizing 
radar  and  panchromatic  imagery  with  a  2  mm  aperture 

5)  classification  of  plowed  agriculture  utilizing  radar 
and  panchromatic  imagery  with  a  2mm  aperture 

6)  comparison  of  decisions  for  water  (60)  and  agriculture 
utilizing  radar  and  panchromatic  imagery  with  a  2  mm 
ape  rturc 

7)  comparison  of  the  results  obtained  for  water  (60) 
utilizing  radar  and  panchromatic  imagery  with  2,4 
and  6mm  apertures. 
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6.  0 


The  first  four  comparisons  correspond  to  cases  for  which 
there  is  a  statistically  significant  difference  between  the  performance 
utilizing  radar  and  panchromatic  imagery.  In  the  fifth  case  there  is 
no  statistically  significant  difference  between  decisions  utilizing  radar 
and  panchromatic  imagery.  We  present  this  case  to  compare  a 
statistically  significant  difference  to  one  that  is  not. 


The  confusion  matrices  in  Tables  5-1  through  5-8  show  a 
distinct  trend  of  overlap  between  the  water  classes,  agriculture, 
forest  and  abstention  actions.  (Recall  that  the  abstention  action  region 
is  the  intersection  of  the  region  in  which  both  forest  and  agriculture 
are  accepted. )  Thus,  we  show  one  example  illustrating  how  this 
confusion  can  come  about. 

Finally,  we  show  specific  examples  comparing  the  water 
detection  performance  of  radar  and  panchromatic  imagery  as  larger 
aperture  sizes  include  varying  degrees  of  shoreline.  This  particular 
example  shows  how  the  specular  return  present  in  the  radar  is 
implicitly  used  as  a  feature  while  the  lack  of  the  specular  return  from 
the  shoreline  in  the  panchromatic  imagery  yields  an  aperture  sample 
containing  on-shore  terrain  and  water  that  is  not  classified  as  water. 

6,  1 _ Urban  Sample  Comparison 

For  the  2mm  case,  20  of  the  26  radar  urban  samples  are 
correctly  classified  while  31  of  the  31  urban  panchromatic  samples 
were  correctly  classified.  To  illustrate  why  errors  occur  in  the  radar 
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6.  1 

based  decisions,  we  have  chosen  two  samples:  one  for  which  both 
radar  and  pan  based  decisions  are  urban  (shown  in  Figure  6-la  and  b), 
and  the  second  for  which  the  radar  decision  is  forest  while  the  pan 
decision  is  urban  (shown  in  Figure  6-lc  and  d). 

Examining  the  wedge  feature  plots  in  Figure  o-.l  for 
these  two  cases,  we  observe  that  the  incorrectly  classified 
radar  sample  does  not  exhibit  the  characteristic  peak  between  weilg.es 
1-1  and  16.  Ibis  peak  which  is  due  to  the  specular  return  in  the  radar 
samples  is  in  tact  what  enables  us  to  distinguish  urban  from  non-urban 
terrain  types.  Observing  the  pictures  in  Figure  6-1  of  the  specific 
aperture  samples,  wo  see  that  while  a  building  is  visible  in  the 
panchromatic  imagery,  orientation  of  the  building  is  such  that  there 
is  no  specular  return  in  the  radar  sample. 

This  single  example  illustrates  the  difference  between  the 
urban  detection  diffraction  feature  used  for  panclu*omatic  imagery 
and  the  feature  used  for  radar  imagery.  The  panchromatic  feature 
is  simply  a  relative  increase  in  high  spatial  frequency  content  duo 
to  the  line  structure  of  man-made  objects.  On  the  other  hand,  the 
radar  feature  is  the  specular  cross  pattern  which  causes  a  similar 
cross  pattern  in  the  diffraction  plane. 

6.  2. _ Representative  Samples  Comparing.  Water  f>P  Panchromatic 

and  Rada  r  Result?: 

For  the  case  of  water  (50),  nine  of  eleven  samples  were 
correctly  classified  using  panchromatic  data  while  only  five  of  nine 
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Figure  6-2.  Comparison  of  Features  for  Urban  Samples  Derived  from 

Panchromatic  and  lladar  Imagery 


i . oo  a. o o 


r/.oo  2;;.oo  :<:«.oo  m.oo 

CLrMr.NI  NO. 


Md  .00  *,7.00 


?.Vl«  <l«K6N>  DfCISION  -  tWOI  POM 

flit  M.i.k.  ‘OOU'S  /MPOO.-.UCtStuSJ  OSINO  kVKftt  MNSi'3 

fs/i'l/,-3  Pi'. $3 


WIM  (IMIS'  PffICION  •  HX'131  PPM  ROTOR 

lot  M  II  >A  MiV.U  /N*l\'.Y  ,'U'ISUV  II,.  I  NO  NVNPPP  NVNU'8 

♦Vi't/VJ  PJ.,'7 


Figure  6-2. 
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were  correctly  classified  from  the  radar  data.  Figure  6-3a  and  b 
shows  a  sample  area  correctly  classified  for  both  radar  and 
panchromatic  data,  while  Figure  6-3c  and  d  shows  a  sample 
correctly  classified  using  panchromatic  data  but  assigned  to  the 
abstention  region  when  radar  data  is  used.  Figure  6-4  contains  the 
feature  plots  for  both  of  these  samples  which  should  be  compared  to 
the  feature  statistical  limit  plots  for  water  (50),  agriculture  and 
forest  in  Appendix  4. 

There  appears  to  be  no  significant  difference  in  the 
diffraction  pattern  feature  signatures  or  in  the  imagery  itself  between 
the  sample  correctly  classified  by  both  sensors  and  the  other  sample 
which  is  correctly  classified  only  using  the  diffraction  pattern  data 
from  the  panchromatic  imagery.  Examination  of  other  samples 
appears  to  substantiate  the  conclusion  that  diffraction  pattern  signature 
difference  causing  the  performance  difference  between  radar  and  pan 
is  more  complex  than  can  be  seen  by  a  simple  examination  of  the 
feature  plots  and  imagery  samples. 

3  Comparison  of  Results  for  Forest  Using  Diffraction  Pattern 

Samples  from  Radar  and  Panch romatic  Imagery 

For  the  2  mm  aperture  case,  199  of  211  forest  samples  were 
correctly  classified  utilizing  the  radar  imagery.  On  the  other  hand, 
for  the  2  mm  aperture  only,  159  of  214  samples  from  panchromatic 
imagery  were  correctly  classified. 
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6.  3 _ --Continued. 

Once  again,  two  specific  sample  areas  were  chosen  to 
illustrate  the  qualitative  differences  between  the  results  for  radar 
and  panchromatic  imagery.  The  sample  area  correctly  classified 
utilizing  either  panchromatic  or  radar  derived  data  is  shown  in 
Figure  6-5a  and  b.  The  area  correctly  classified  from  radar  but 
incorrectly  classified  from  pan  is  shown  in  Figure  6-5c  and  d. 
Corresponding  feature  plots  that  may  be  compared  to  class  feature 
statistics  for  forest  and  agriculture  are  shown  in  Figure  6-6. 

Observing  the  pictures  in  Figure  6-5  we  conjecture  that 
the  superior  performance  of  the  OPS  measurement  data  derived  from 
radar  imagery  is  due  to  tree  crown  and  branch  induced  texture  which 
is  more  pronounced  and  consistent  in  radar  imagery  than  in  panchromatic 
imagery.  The  texture  associated  with  forest  in  panchromatic  imagery 
is  quite  often  duplicated  in  non-forest  agricultural  regions.  This  is 
consistent  with  the  decision  results  shown  in  the  confusion  matrices 
(Tables  5-1  through  5-8)  where  a  significant  ambiguity  between  forest 
and  agriculture  exists  for  the  panchromatic  samples. 

The  difference  in  texture  appearance  is  obviously  due  to 
the  different  sensor  wavelengths.  The  appearance  of  the  forest  areas 
in  the  radar  reconstruction  is  very  similar  to  the  speckle  pattern 
observed  in  photographs  when  a  rough  surface  is  illuminated  by 
coherent  visible  wavelength  light.  The  relationship  between  the  radar 
illumination  wavelength  and  the  surface  height  structure  in  the  forest 
areas  is  undoubtedly  quite  similar  to  the  wavelength  and  height  profile 
relationship  for  a  visible  wavelength  and  typical  optical  diffuser. 
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6.  -I _ Comparison  of  Non- P  1  ow  od  \  s  rice  11  u  n-  (70)  IV  rformamv 
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■Imai'ory  (,1mm  aperture) 

In  this  case,  45  of  53  non-plowed  agriculture  samples 
identified  utilising  Ol'S  measurements  from  radar  imagery  were 
correctly  identified.  The  corresponding  number  for  samples  derived 
from  panchromatic  imagery  was  33  of  48  samples.  Once  again,  we 
compare  samples  correctly  identified  in  both  cases  and  a  sample 
correctly  identified  for  the  radar  case  but  incorrectly  identified  for 
the  panchromatic  case.  Pictures  of  these  samples  are  shown  in 
Figure  6-7.  The  corresponding  feature  plots  which  can  be  compared 
to  the  feature  statistic  plots  for  agriculture  and  forest  in  Appendix  4 
arc  shown  in  Figure  6-8. 

The  only  observed  difference  in  this  case  between  the 
radar  imagery  and  the  pan  is  that  the  field  boundaries  are  not  as 
visible  in  the  panchromatic  imagery  as  they  are  in  the  radar.  Also, 
as  noted  previously,  the  forest  texture  is  much  more  pronounced 
and  different  from  the  agriculture  texture  in  radar  imagery  than  it 
is  in  the  pan  imagery.  Since  the  correct  classification  is  based  on 
distinguishing  agriculture  from  forest  we  conjecture  that  the 
combination  of  poor  text'll  re  differentiation  in  pan  between  radar  and 
agric  ltu re  as  well  as  the  absence  of  field  boundary  lines  in  pan 
accounts  for  the  difference  in  performance. 

6.  5 _ Comparison  of  Plowed  Agriculture  (.'0)  Peei sion  Pcrfo nuance 

IHili.'lng  Cl  A  Samples  t  rein  K.uia  r  and  1  'a  nc h romat  ie  Imagery 
(.*  mm  ape  rtu  rc) 

Overall  results  for  radar  are  60  of  7.1  agriculture  (70)  samples 
correctly  classified  while  for  panchromatic  only  48  of  83  are  correctly 
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6.  5 


classified.  Photographs  of  the  samples  correctly  identified  in  both 
cases  are  shown  in  Figure  6-9a  and  b  while  the  s.unpk’s  correctly 
classified  from  radar  and  incorrectly  classified  from  pan  samples 
are  shown  in  Figure  6-0c  and  d.  The  corresponding  feature  plots 
are  shown  in  Figure  6-10.  These  should  be  compared  to  the 
statistics  for  the  feature  families  shown  in  Appendix  4. 

Comments  concerning  the  plowed  agriculture  samples  in  this 
case  are  essentially  the  same  as  those  in  the  previous  section  concern¬ 
ing  non -plowed  agriculture.  In  general,  in  the  samples  available,  it 
was  extremely  difficult  to  discern  any  visual  difference  between 
samples  classified  as  plowed  and  samples  classified  as  non-plowed. 
Wherever  some  degree  of  directed  line  structure  was  present  in  a 
field,  the  sample  was  classified  as  plowed.  However,  quite  often 
this  line  structure  did  not:  have  sufficient  contrast  to  form  the 
characteristic  diffraction  pattern  of  a  grating. 

6.6 _ Comparison  of  Results  for  Water  (uO)  an  d_  \i-  ricu  Here 

Utilising  Optical  Powe  r  Spect  rum  Me;i su  rements  t'r om 

Under  and  1 :ic  1 1  rom  .it  ie  lm.  er\  with  ad  mm  Samp]  in;1. 

Aperture 

In  this  case  we  wish  to  compare  a  sample  area  in  the 
water  (60)  region  to  another  in  agriculture  that  appear  to  have 
identical  texture  in  the  panchromatic  format,  but  markedly  different 
texture  in  the  radar  reconstruction.  The  two  areas  are  pictured  in 
Figure  6-11.  The  corresponding  optical  power  spectrum  feature 
plots  should  be  compared  to  the  class  feature  statistics  for  water, 
agriculture  and  forest  in  Appendix  4  as  shown  in  Figure  6- Id. 
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Figure  6-10.  Comparison  of  Features  for  Flow  oil  Agriculture  Samples 
Derived  from  Panchromatic  and  Radar  Imagery 
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For  the  panchromatic  imagery,  the  water  sample  is 
incorrectly  classified  as  forest  while  the  agriculture  sample  is 
assigned  an  abstention  action.  (Recall  that  an  abstention  in  this 
case  is  due  to  the  fact  that  the  sample  falls  in  the  region  of 
acceptance  for  both  forest  and  agriculture.)  For  the  radar  case, 
the  water  sample  is  correctly  identified  as  water  ( 6 0)  and  the 
agriculture  correctly  identified  as  agriculture.  This  points  out 
once  again  that  optical  power  spectrum  analysis  essentially  provides 
a  measure  of  texture.  When  the  sensor  type  is  such  that  unambiguous 
texture  differences  correspond  to  different  terrain  types  as  is  the 
case  here  for  radar,  the  correct  decision  will  result.  On  the  other 
hand,  when  no  apparent  texture  difference  can  be  associated  with 
different  terrain  types,  as  is  the  case  lie  re  for  the  panchromatic 
imagery,  an  incorrect  or  abstention  action  will  result. 

Ail _ Qualitative  Fxami a. -turn  of  the  Results  for  Wat er  ( 60)  When 

/■,  -1  and  Omni  Anuria  ro  Sample?:  are  i'.’.'mn  from  Radar  and 

Panchromatic  Jnnverv 

This  example  examines  what  may  at  first  appear  to  be  a 
strange  result  in  the  classification  of  water  (6 0)  for  2,  -1  and  6  mm 
apertures,  1*  or  the  radar  sensor,  the  results  for  2,  -1  and  6  mm 
apertures  are  respectively  19  of  19,  12  of  19  and  19  of  19  correctly 
classified.  On  the  other  hand,  for  panchromatic  imagery  the 
corresponding  results  are  2.1  of  26,  0  of  26  and  6  of  26  correctly 
classified,  figure  6-13  shows  the  radar  samples  that  will  be 
considered,  while  figure  6-11  shows  the  panchromatic  samples. 
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6.  7.  1 _ 2  mm  Aperture  Results 

Basically  wo  observe'  tliat  in  the  2  mm  case,  all  of  the  radar 
samples  arc  solidly  within  the  water  and  no  shoreline  is  present.  On 
the  other  hand,  a  few  of  the  panchromatic  samples  include  a  portion 
of  the  lower  shore  and  are  classified  as  Forest  or  are  assigned  an 
abstention  action.  Thus,  in  the  2mm  case,  both  radar  and  pan  will 
correctly  classify  all  samples  which  are  completely  within  the  water 
area. 


6.  7  ■  l _ -1  mm  Aperture  Uesul Is 

For  the  4mm  aperture,  the  12  of  19  radar  samples 
correctly  classified  all  contain  a  strong  specular  reflection  from  the 
upper  shoreline.  nho  other  samples  not  containing  the  specular 
return  are  all  classified  as  agriculture.  Thus,  in  effect  the  system 
has  trained  itself  to  recognize  this  river  water  on  the  basis  of  the 
specular  return  from  the  shoreline.  (Figure  o-15  shows  the  wedge 
clue  comparison.  ) 


On  the  other  hand,  all  panchromatic  samples  are  incorrectly 
identified  because  some  shoreline  is  present  in  all  samples.  The 
shoreline  near  the  river  basically  contains  trees  and  appears  as  forest. 
As  one  moves  further  inland  from  the  shoreline,  the  shoreline  trees 
thin  out  and  a  more  agricultural  type  terrain  is  present.  This  in  fact 
corresponds  to  the  decisions  obtained.  Those  samples  with  relatively 
little  shoreline  are  classified  as  forest,  while  those  that  contain  more 
shoreline  are  typically  assigned  the  abstention  action  corresponding 
to  a  mixture  of  forest  and  agriculture. 
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For  the  6  mm  aperture,  all  samples  had  at  least  one 
shoreline  in  view.  Thus,  a  specular  shoreline  return  was  present 
in  all  19  of  the  radar  samples  and  all  were  correctly  classified. 

On  tlie  other  hand,  only  6  of  the  26  pan  samples  were  correctly 
identified.  For  the  most  part,  these  were  samples  in  the  middle 
of  the  river  containing  mainly  water  with  relatively  small  amounts 
of  shoreline.  Where  both  shorelines  were  present  a  decision  was 
forest,  and  where  oidv  a  single  shoreline  was  present  both  forest 
decisions  and  abstention  actions  resulted.  In  this  case  once  again, 
the  radar  specular  return  was  implicitly  recognized  in  the  training 
algorithm  as  an  indicator  of  shoreline  implying  a  river  sample.  On 
the  other  hand,  the  lack  of  a  specular  return  and  the  inclusion  of 
forest  and/or  agriculture  terrain  in  the  panchromatic  sample  caused 
a  correct,  incorrect  or  abstention  decision  to  be  made  depending  on 
the  amount  and  position  of  each  terrain  type. 


CONCLUSIONS  AND  SUGGESTED  FURTHER  STUDY 
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7.  I _ Conclusions 

7.1.1 _ Overall  Performance  for  Different  Sensor  Types  Differ 

The  major  conclusion  drawn  from  this  study  is  that  while 
optical  power  spectrum  analysis  can  be  applied  to  imagery  derived  from 
panchromatic  visual  sensors,  synthetic  aperture  radar  sensors  and 
scanning  thermal  imagers,  the  detection  capability  in  general  and  for 
specific  terrain  types  is  influenced  by  the  sensor.  This  is  primarily  due 
to  the  fact  that  optical  power  spectrum  signatures  arc  strongly  influenced 
by  image  texture  so  that  the  variation  of  terrain  texture  as  a  function  of 
sensor  strongly  influences  automatic  detection  capability. 

It  is  not  surprising  that  the  different  sensors  will  produce 
imagery  with  different  texture  characteristics.  The  radar  sensor  uses 
a  wavelength  considerably  longer  than  either  the  thermal  or  the  panchromatic 
imager.  Furthermore,  the  radar  "illumination"  is  coherent.  Therefore, 
speckle  and  specular  reflection  characteristics  appear  in  the  reconstructed 
imagery  for  this  sensor  type.  In  fact,  as  noted  in  Section  6,  the  computed 
chi  square  value  indicates  that  radar  differs  to  a  greater  extent  from  either 
panchromatic  or  thermal  imagery  than  panchromatic  differs  from  thermal 
imagery. 


Certain  Sensors  are  Better  for  Specific  Terrain  Types 


While  the  results  do  differ  by  sensor  type,  no  single  sensor  is 
uniformly  better  than  the  other.  In  particular,  urban  area  detection 
performance  is  better  using  panchromatic  samples  than  using  radar  or 
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thermal  samples.  A  detailed  comparison  of  panchromatic  and  radar  images 
indicates  that  this  is  because  the  urban  line  structure  texture  in  panchromatic 
imagery  presents  a  strong  signature  in  the  corresponding  diffraction 
patterns.  On  the  other  hand,  radar  imagery  causes  a  unique  signature  in  the 
optical  power  spectrum  whenever  a  specular  return  occurs  from  a  man-made 
object  acting  as  a  corncrcube  reflector.  In  some  urban  areas,  the  specular 
return  does  not  occur  even  when  a  strong  line  structure  texture  is  present 
in  the  panchromatic  imagery. 

On  the  other  hand,  optical  power  spectrum  samples  from  radar 
imagery  generally  provide  better  results  than  corresponding  samples  from 
panchromatic  imagery  for  detection  of  agriculture  and  forest.  This  appears 
to  be  due  to  the  fact  that  the  textural  differences  associated  with  these 
cla  sses  are  more  distinct  in  the  radar  imagery  than  in  the  panchromatic. 

Finally,  it  would  appear  by  examining  Table  7-1  that  the  best 
situation  would  be  to  use  panchromatic  imagery  to  detect  urban  areas  and 
water,  radar  to  detect  agriculture,  and  thermal  to  detect  forest.  One 
would  not  do  very  much  worse  utilizing  radar  to  detect  water  and  forest 
as  well.  In  fact,  were  a  single  sensor  to  be  chosen,  the  choice  would 
most  likely  be  radar. 
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7.1.3 _ Apcrlv.ro  Size  Effect 


The  effect  of  aperture  size  on  the  sampled  imagery  is  not  uniform 
for  panchromatic  and  radar  imagery.  No  statistically  significant  effect  was 
observed  for  different  size  apertures  insofar  as  their  influence  on  detection 
performance  for  the  radar  imagery.  One  should  of  course  take  into  account 
the  discussion  of  the  river  water  recognition  in  Section  6  that  ostensibly 
does  not  change  as  a  function  of  aperture  size.  This  of  course  is  true 
insofar  as  the  statistics  are  concerned,  but  the  closer  analysis  in  Section  6 
shows  that  the  mechanism  causing  the  decisions  does  in  fact  change. 

For  panchromatic  imagery,  the  decision  results  are  statistically 
different  as  the  aperture  size  is  changed.  However,  there  appears  to  be 
no  specific  trend  relating  aperture  size  to  improved  decision  performance. 

In  fact,  the  differences  appear  to  be  due  primarily  to  the  river  water/ 
shoreline  effect  discussed  in  Section  6  and  the  forest/agriculture  decision 
partition.  In  effect  then,  changing  the  aperture  size  affects  decision 
performance  because  of  changes  in  the  number  of  terrain  types  present 
in  an  aperture.  This  is  really  a  manifestation  of  the  problem  of 
unambiguously  defining  terrain  boundaries  that  run  through  individual 
optical  power  spectrum  sample  apertures. 


7 .  1.4 _ Conclusion  Generali  tv 


Finally,  we  should  point  out  that  the  results  obtained  here, 
although  involving  a  substantial  number  of  samples  for  certain  classes,  must 
still  be  considered  tentative  and  preliminary.  Even  assuming  that  our 
results  for  the  panchromatic  and  radar  imagery  are  statistically  valid,  the 
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samples  included  in  this  study  are  from  a  very  small  region  around 
Huntsville,  Alabama.  Without  considering  a  broader  range  of  geographical 
locations,  one  could  not  assume  that  these  results  would  hold  in  a  general 
setting.  Also,  since  the  region  over  which  the  thermal  imagery  was 
acquired  was  geographically  remote  from  the  Huntsville  area,  our 
comparisons  of  thermal  results  to  results  for  panchromatic  and  radar 
involve  the  assumption  that  although  the  terrain  was  not  identical  the 
terrain  characteristics  were  similar. 


7.  Z. _ Areas  for  Further  Study 

In  a  certain  sense  this  study  has  raised  more  questions  than 
it  has  answered.  But,  this  is  the  purpose  of  an  initial  study. 

7 .  .  1 _ i'.x'onnded  and  Own-ini'  ml  1 'xpo  rime -it 


An  obvious  area  for  additional  work  is  to  broaden  the  range  of 
the  data  base  to  include  more  samples  reflecting  more  general  terrain 
type s  and  test  the  results  obtained  in  this  study  in  a  more  general  setting. 

7 ,  '.l .  2 _ Terrain  Boundary  rVto  rmination 

1"  the  context  of  the  decision  rule,  we  have  raised,  but  not 
significantly  considered,  the  question  of  how  to  treat  boundary  determination. 
This  is  clearly  a  key  question  for  any  automatic  topographic  classification 
system.  Our  results  with  samples  not  included  in  the  training  class  because 
they  were  on  a  boundary  being  assigned  the  abstention  action  indicates  that 
it  may  in  fact  be  possible  to  automatically  identify  areas  tint  include  a 
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boundary  between  two  terrain  types.  Obviously  additional  processing 
techniques,  perhaps  some  combination  of  digital  image  processing  and 
optical  power  spectrum  analysis,  will  be  required  in  order  to  correctly 
identify  boundaries. 

The  ability  to  identify  boundaries  is  important  for  another 
reason  as  well.  Individual  aperture  sample  decisions  are  based  on  local 
texture.  We  have  seen  examples  in  which  local  texture  is  not  sufficient 
to  unambiguously  identify  terrain  type .  On  the  other  hand  knowledge  of 
boundaries  provides  a  contextual  framework  within  which  a  more 
"intelligent"  decision  can  be  made  about  a  particular  sample.  For  example, 
it  is  unlikely  that  a  200  foot  square  lake  will  exist  in  the  middle  of  a  plowed 
agricultural  field. 

7.2.3 _ Decision  Rule  Improvement 


Finally,  in  the  course  of  this  study  we  have  developed  a  decision 
rule  and  an  approach  to  the  development  of  similar  decision  rules  that 
appears  useful  for  multiclass  problems  with  numerous  classes  and 
relatively  few  samples  from  each  class.  The  rule  is  basically  a  threshold 
decision  rule,  similar  to  the  one  utilized  in  M1STIC.  However,  the 
threshold  is  not  based  on  a  comparison  of  the  posterior  probability  estimate 
to  a  threshold.  It  would  be  worthwhile  to  consider  how  the  rule  structure 
developed  during  the  course  of  this  study  can  be  extended  so  that  it  is  based 
on  the  posterior  probability.  If  this  can  be  done,  we  can  directly  evaluate 
how  close  the  decision  rule  performance  is  to  the  Dayes  Rule  by  examining 
the  percentage  of  ambiguous  decisions^  \ 
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APPENDIX  2 


X2  TEST  RESULTS  FOR 

PANCHROMATIC  APERTURE  PERFORMANCE  COMPARISON 
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APPENDIX  4 


CLASS  STATISTICS  PLOTS  - 
2MM  APERTURE  PANCHROMATIC  AND  RADAR  CASES 
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